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ABSTRACT 

The Partners in Elementary Science (PIES) program of 
th** Nation, i Science Foundation (NSF) is a model Teacher Enhancement 
project. Its goal was to" develop and test a prpgram to help 
elementary teachers strengthen tiieir science teaching by addressing 
areas of need, specifically teachers* confidence in teaching inquiry 
science and helping teachers overcome forces inhibiting the teaching 
of science. The NSF/PIES project was sponsored by the Five , 
College/Public School Partnership — a school/collsge collaborative 
initiated in 1984 to share resources and strengthen communication 
between the 43 school systems in the 4 western Massachusetts counties 
and members of the higher education consortium. Five Colleges r. Inc. 
(Amherst, -Hampshire, Mount Holyoke, and Smith Colleges, an'^ the 
University of Massachusetts at Amherst) . The Administrator s report 
presents th'^ various aspects of the program in chronological order: 
(1) staffinc, • (2) participants; (3) spring prfe-institute workshops; 
(4) institute; (5} academic year follow-up; and (6^ continuation. 
Each section includes a ^^rief description followed by suggestions to 
other administrators starting similar projects. The Evaluator's 
report is divided into two sections. The first is a summary report 
which looks at NSF/PIES as a successful staff development project and 
analyzes the reasons for its success. The second'is a series'of 
presentations and discussions tor each major data spurc^e used in the 
process. Appended are all of the questionnaire and interview 
protocols, the criteria used by the people who made the classroom 
observations for the project, and a full chronology of project 
events. (KR) 
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NSF/PARTNERS IN ELEMENTARY SCIENCE: CASE STUDY IN STRENGTHENING SCIENCE 
TEACHING IN THE ELEMENTARY SCHOOLS - - 



ADMINISTRATOR'S FINAL REPORT 



NSF/Partners in Elementary Science (NSF/PIES.) was.fimded in 1987 by the 
National Science Foundation as a model Teacher Enhancement Project.* Its 
goal was to develop and test a program to help elementary teachers 
strengthen their science teaching by addressing two areas of need: 

to strengthen elementary teachers* confidence* in teaching inquiry 
science in the classroom (what we came to call •'Hands-on, Hinds-on 
Science"); . .> 

to help teachers overcome forces inhibiting the teaching of science 
(classroom management problems, lack of resources, pressure to focus 
OD other subjects, lac'k of administrative support). 

The project officially ended in June 1989 when the second cycle of NSF/PIES 
Fellows completed their program. However ^ our comnitient to the 
participants has continued this past year and will continue for many years 
to come. We can now say with coitfidence that NSF/PIES has developed an 
appr'-^ch to teacher enhancement which should be considered by others 
interested in improving elementary science educ&tion. 

Organization of the Report: As with all complex programs, there were many 
components of NSF/PIES. This report will present the various aspects of 
the program in chronolog:^cal order,. , " 

Staffing: both 1;he selection of staff and planning by them; 

Participants: recruiting and selecting 50 eieiientary teachers/year 
from our area schools (.November-March of each year); 

Spring pre-institute workshops: 2 Saturdays in March and April to 
introduce concepts and individuals; 

Institute: 3-week, non-residential summer program in July 
(Facilities, Science Strands, Writing, Student Program); 

Academic year follow-up (Resoiu*ce Teacher, Workshops, Workshops for 
Principals, Evaluation); 

Continuation (Science/Resource Workshops, Leadership Training). 

Each section will include a brief description, including changes between 
the first cycle (1987-1988) and the second cycle (1988-1989) of the 
program, followed by suggestions to other administrators starting similar 
projects. References will be made to the evaluator's report which appears 
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as Part II of this Final Report. Every effort has been made to not 
duplicate the information and recommendations found' in that report. 
NSF/PIES staff have also prepared publications on this project a list 
appears at the end of this report. 

Background: The NSF/PIES, (Partners in Elementary Science) Project was 
sponsored by the Five College/Public School Partnership - a school/ college 
collaborative initiated in 1984 to share resotirces and strengthen 
communication between the 43 school systems in the four western 
Massachusetts counties and members of the higher education consortium, Fiye 
Colleges, Inc. (Amherst, Hampshire, Moi2nt Holyoke, and Smith Colleges, and 
the University of Massachusetts at Amherst). One of the first planning 
committees formed- within the Partnership was made up of science teachers 
from the elementary, secondary and college level. ^ Within six months, that 
original committee had split into committees of high school and college 
faculty in physics, biology, and chemistry. The elementary teachers, who 
felt left out in xhe re-organization, began searching for school and 
college icience faculty who would understand their unique needs • The 
NSF/PIES proposal ^developed from these meetings. There i's no doubt that 
the strength of the initial design and the quality of the staff was assured 
by the careful planning done by the proposal-writing committee* 



STAFFING 

The original proposal to the, National Science Foundatipn included a 
teaching staff of three school faculty, two college faculty (serving as co- 
directors), and two staff members frgm the Hitqhcpck Center for the 
Environment. The staff also included an evaluator, *and a project 
administrator (Coordinator of the Five College/ Public School Partnership 
and author of this report. ) While there was some change in personnel among 
the school faculty as other responsibilities and profesr-lonal opportunities 
arose, the mixture of school, college, and environmental center teaching 
staff remained^ Each teaching staff member also brought a strongs 
backgroiind. in science, a philosophic commitment to the hands-on, minds-on 
approach to teaching science, superb teaching skills, and a willingness to"" 
tak3 the time to plan together,. A list of the NSF/PIES staff members 
appears at the end of this report. 

fhfef' evaluator's final report lists the shared philosophic goals of the 
.staff as one of t^e streng:^hs of the project.^ While careful selection of 
staff obviously contributed to such a common philosophy, it was equally 
important to balance the staff to reflect the diversity within our 
community. In the long run, the willixigness of the staff to take time to 
discuss issues thoroughly and to confront differing styles and assmptions 
was surely as important as initial selection. 

Administrative Suggestions : Staff of any project must simultaneously: 

reflect the diversity of the partners (school/ college/ science 
center , primary/ intermediate , urban/ suburban/rural ) ; 
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qncourage challenging, intellectually simulating discussion vhich 
forces the staff toT)e as reflective of- the program as "participants 
will be asked to be in their ovn classroom; 

include administrative support so that staff vhp have other academic 
year responsibilities will not get bogged down in mailings and 
deadlines; ^ . ^ 

include enough planning time so that staff^ can talk through 
alternative ways to provide support for participants; 

develop a climate of mutual support that makes participation iu the 
project personally rewardixig and models the sharing of resources and 
ideas so vital to strengthening our elementary science programis. 



PARTICIPANTS 

In the first cycle of the project (198771988), iaost of the 52 elementary 
teachers were recruited ffom the five -school systems which had participated 
in preparing the proposal - 24 teachers came from two of those 'systems (a 
total of 16 systems werfe represented). In the second tiycle (1988-19897; 
teachers from all 43 systems were invited to participate* We had 40 
teachers from 20 systems participating. (Teacher cutbacks during the spring 
discouraged some of those accepted from actually attending). Since the 
institute was not residential, most of our participants came from school 
systems within a hour's- drive of Hamp^shire. College. Berkshire- County 
schools, vhich make up 10 of our school districts and are all more than an 
hour's drive away, had only 3 participants from 2 systems. 

Each year participants were nearly equally divided betwee n primary and* 
intermediate grades. Each year included teachers from self-contained 
classrooms, from grade-level teams, and from special services including^ 
special education teachers, gifted and talented coordinators,, lai-lingual, 
and ESL teachers. There were many more women than men (ratio each year pf 
9:1) • accurately reflecting the staff Itig of our elementary schools. Each 
participant received a $680 stipend and could receive 3 graduate credits 
through the University of 'Massachusetts. ^ ^ ^ 

A dministrative Suggestibiis ; ' It is tempting to recruit participants from 
only a feif school systems - publicity is easier and participants caii' rely 
on pach other for support in the future . Our experience in this project, 
and in all Partnership programs, has been that there is a delicate balance 
between encouraging colleagues to participate together, on the one hand, 
and having a program dominated by pre-established cliques, on the other. 
Any program trying to promote the sharing of ideas and resources must 
confront this issue either by actively recruiting from the widest possible 
rangft of schools or by encouraging the formation of cross-district teams 
within the program itself. Recruiting for established programs is much ^ 
easier: all oif our second-year participants reported having been encouraged 
to sTjply by first-year participants (at school, in the community, through 
friends, at professional meetings.) I list of the NSF/PIES participants 
appears at the end of this report. 
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SPRING PRE-INSTITUTE WORKSHOPS 

All participants ^vere asked to come to two Saturday workshops (one in 
March, one in April), There were four goals for these two days;^ 

to allow the staff to meet the participants so that through 
conversation and an efxtensive questiormaire ve could be sure that 
the summer institute program would be. appropriate; 

to introduce participants v to- the staff, the buixdiDgs, and the 
program (four 3-ho^^^ activities introduced the components of the 
summer institute); 

to give the participants simple activities to try with their 
students durizig the sprixig so that vthey would not arrive at the 
institute saying ♦♦Hy kids couldn^t do/wcfuldn't like. this. . 

to build a sense of community and reduce the anxiety that makes the 
, first days at an institute so tiring. . 

NSF/PIES vas, in fact, the^ first Partnership institute which included a 
.pre-institute program. Bp.sed on its success, wje now include it whenever 
possible in iur programs - and always regret not including it when it seems 
too difficult to arrange. From an administrative view, the pre-institute 
events also help establish deadlines for the staff, thereby avoiding a 
late-June panic. 

Administrative Suggestions :- Projects which -draw participants from great 
distances usually cannot offer pre-institute. workshops. However, sucl^ 
events Isontrlbute immeasurably to the conf^rdence that both ;Staff and 
participants bring to the siimmer program. Since the, events of ;those daycf 
will,_for better or worse, set the tone for the program, having_activities 
that reflect at every level (topics, methodology, pacing, food, space) the 
philosophy, goals, and content of the program is essential. 

SUMMER INSTITUTE 

> 

'FACILITI2S ' 

The NSF/PIES summer institute was held at Hampshire College, home campus 
Co-director Merle -Bruno. The college pi'ovided us with: 

an appropriate space (work tables, good light, air conditioning, 
large and small teaching areas, space for a Resource Center); 

healthy, Csnjoyable lunches for staff and participants to/^ether in 
the Dining Commons; 

easy parking; 

swimming and gym facilities; 

7 
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a sense of being valuecT"- an attractive campus, a picnic at the 
President's house » ant^ a thoughtful staff* 

it was especially important for us to emphasize the effective use of space 
because our public schools, perhaps more secondary than elementary, tend to 
ignore the messages given by teaching, spaces* The second year of the 
project, the staff Was offered an interesting Vclassroom (the art building), 
but felt so strongly about the need for an attractive setting, that they 
spent the fourth of J^uly weekend painting the walls! * Work tables were 
covered w:lth interesting fabrics, bouquets of wild flowers greeted^ 
participants every day. 

Each year, the kescurce Center was the hub of the physical space and of 
activity (where the coffee, was)* Participants coilcei*ned about the poor 
quality and high cost of science materials were able to browse through 
excellent, inexpensive materials ~ to share, ^ borrow, and discutfs them with, < 
Peg HacDaniel, -the knowledgeable librarian, from the Hitchcock Center* 

Administrative Suggestions ; Inappropriate space '(»too' fancy, uglyV hot, 
unsafe, dirty) sends a clear message to participants (of any age) that they 
are not vialued* It is also the worst possible model of a teaching 
environment appropriate for the elementary classroom* 

Encouraging participants to examine and discuss curricular materials - 
especially those appropriate for their meager school budgets - is. clearly 
desirable* Going the- next step to establish a. functioning Resource Center 
(or to borrow spaoe in one that already exists) is ideal - bpth^ ^s a 
hospitable area for participants and as a model of supportive educational 
environments* 



SCIENCE COURSEg (STRANDS) . ^ _ ^ 

During the first year, the staff offered 2-houi!t week-long •♦strands** (short 
cpursei^ with ^emphai^is on experiential learning) in the physical and natural 
sciences' (Electricity,, The Sky, Life, Babbles)* Other cJass^time was taken 
up with science mini-course-and lectures/panels on inquiry sciehcje, the 
process approach to teaching writing, peer observsctioH, curricular 
resources, and working with administrators* The second year, the 
lectures/panels were reyisedj science mini-courses., .inquis*y science and 
writing (now limited to journal writing.), and curricular resources yere 
taught vithin the strands. Peer observation was eliminated* The changes 
enriched each science strand (the instructors could now discuss both the 
s(^iencp. and the methodology) and provided time for more strands (four one- 
week strfinds were offered ) . In response to the differing needs of the 
participants: those who wanted more science topics (usually primary 
teachers) and those who wanted more depth (usually intermediate teachers), 
the four strands were offered at both a beginning and advanced level* 
Participants could take four introductory strands, tht^ee introductory and 
one advanced, or two introductory-advanced strands 02x: Critters^ in the ^ 
Classroom, Forces and Structures, Outdoor Science at Your School Site, 
Water *^ Time was lefjb during :the final week to offer minirworkshops by 



8 



NSF/PIES Final Report page 5 



participants on their areas of special skill (kites, kaleidoscoper, nature 
trails, growing plants)* ^ ^ H 

_ , # 

Administrative Suggestions : Teachers, whether staff at an institute or in a 
classrx)om, always want to "cover all the essential material ac^d It ±m 
never possible* It is certainly not pi^ssible to provide elementary """^ 
teachers with the eqi'ivalent of an undergraduate degree in science in three 
weeks! It is, therefore, essential that the topics choMii reflect an 
approach to understanding basip scientific principals and^mlsconceptions, 
to using resotrces, to using the, inquiry approach to touching science ^ and 
to inviting students* questions that can be applied to new subjects areas* 
The topics will vary with the teaching circumstances^ oj^ the participants, 
the expertise of .the staff, and the classroom materials available* 
Collectively the topics chosen should include differixig classrooid 
management problems (of materials, students, and evaluation strategies}* 



WRITING 

Using writing in the science classroom as an evaluative tool, for both the 
teacher and the student,, evolved over the two years* We had initially 
hoped that most of the participants would already be familiar with the ^ 
process approach to the teaching of writing* When it became clear that 
very few of our participants were using the writing process - and that it 
was not possible to introduce it properly in the time available to us, we 
confined our e!.q)ectation to having participants learn ways to use science 
Journals (essentially offerixig a case study in the process approach jto the 
teaching of writing)* 

The first year, we had the ad:!itional problem of saying that scl&nce and 
writing, shoulr, be integrat;ed, but not having science ^staff who could, 
themselves,, teach about writing* Haying, writing co^sialtants, who were not 
full-time staff members, reinforced the separateness of writing- The 
second year the writing consultants worked with the staff, instead of the 
participants, to help i:hem develop a more integrated science/writing 
program* In subsequent projects (especially the NSF/SpaceMet space scieuce 
project' for middle school cetacliers), we have been more succossful in 
integrating writing into every aspect of the project* 

Given these problems we we»»e not surprised that very few teachers reported 
using scieiice Journals during the academic year 'after thd institute* We 
have been pleased that our long-range evaluation indicates that these same 
teabhers, now confident about teaching 8ciehct.> have turned their attention 
to stx^engthening the role of writing in the science classroom* (However, 
the f|artnership and many of the school systems offer programs in using the 
process approach to teaching writing* While NSF/PIES has surely 
contributed to the increased use of writing in science, it is not the sole 
cause* ) 

Administrative Suggestions : Interdisciplinary teaching is surely 
intrinsically desirable at every level, kindergarten through college* 
Furthermore, as the time pressures on elementary teachers increase, every 
effort to have an activity serve more than one skill ai ea/ discipline helpf: 
both teachers and students* Writing is an especially rich resource for 
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science teacher's - .both to help them (and the student) understand hoy the 
student is thinking about a problem, and to provide a focus for required 
writing activities > In retrospect, including more mathem;atics - especially 
in light of the nevHCTM Standards - would also have been, desirable* A 
cautionary note: if the institute staff do not use vriting .^s a 
teaching/ evaluation tool in the project, the participants will not use it 
in their own classrooms* 



STUDENT PROGRAM 

One of the problems with the inquiry approach to teaching science is that 
teachers are often reluctant to try such messy, open-ended, challenging 
activities with thleir students, ♦♦the children will just make a mess*.** 
they can't do ainything that complex. . . they will get out of control." 
Recognizing that the' only argument against such fears is wprkirig with 
children, we' arranged lor teams of participants to work with students for 7 
two-hour sessions. We were fortunate to > be invited to work with the 
Massachusetts Migrant Education Program whose students were in two summer 
school programs approximately a half hour from Hampshire College. The- 
program provided the extra advantage of introducing many of our teachers to 
their first experience in bi-lingusil classrooms. 

It is difficult to determine how successful this component o.f the program 
was. It clearly achieved two goals: no teacher left the sum^mer saying that 
students can't do/won't like/aren't able to manage this approach to 
science. In addition, both the Massachusetts Migrant Education Program and 
our staff and participants ^.earned about new resotirces that they might 
otherwise never have discovered. However, the travel time to, the sitf;s, 
the complexity of working with new students and with another group 
teachers limited theA^alue for some of the participants, llie very fact 
that this is the only component of the program which we have not tried tc 
replicate within the Partnership- indicates our ambivalence. 

Administrative Suflpestions ; It is important to determine whether working 
with children^ during a summer institute will ephance the .learning 
experience for teachers. Based on our experience in this program and a 
small follow-up project with eight NSF/PIES> graduates (W2.tson and Konicek, 
1990), we have concluded that only if the participants have an opportunity 
to work in depth with a few students, to follow their thinking processes 
for a period o£^ time, does such a component seem to be of value. 



ACADEMIC YEAR FOLLOW-UP 



RESOURCE TEACHER 

The NSF/PIES project was fortunate to have a half-time Hitchcock Center 
Ftaff member available to work with our summer institute' participants 
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, during the academic year. - In her 2 1/2 day/week she served as: 

cheerleader - visiting and encouraging teachers In their science _ 
activi^^ies; 

haiiXex) of resourcas brlngins. NSF/PIES books and Irits from the 
Hitchcock Center to the participants to try with t^eir students a' i 
share with their colleagues; 

master teacher - sometimes teaching classes* but more often teaming 
with a participant on a new science trnlt; 

liaison between participants and staff - lling staff what was 
actually happening in the classrooms. 

A successful resoiu^ce teacher must have the conf J dence of the participants. 
Our resource teacher found her Job much easier the second yeiir* vhbn she 
had been a fully participating staff member dui^ing the summer and was 
therefore known and. respected by the participants, than the first year when 
a new baby kept her from actively participating durizig the sy^er. 

Administrative Suggestions ; There is no doubt that having a skilled stafi? 
member available during the academic year will greatly enrich any project 
In which teachers are asked to make changes in their classroom. Tnis 
person must be a member of the teaciilng staff, i.e. must sh^e the project 
history with the staff and participants. It is important to note that this 
job is totally unrelated to the administrative support of the project - and 
probably should not be combined with it, since administrative details can 
swamp good intentions to visit school sites. 



Each year, participants were invited to 2 release-day- workshops and 4 
a/fternoon events. These events were planned by a voluntary committees of 
participants. The second-year participants invited first-year participants 
to join tfiem. The purpose of these events to: 

re-kindle the enthusiasm of the summer; 

provide an opportunity for participants to bring their principals to 
a reception/lecture-demonstration about the project and Zhe teaching 
of science; 

provide an opportunity for participant's to lead workshops on 
successful science activities they had developed; 

introduce participants to new resources, including training by GEMS 
(Lawrence Hall of Science, Berkeley) staff; 

build toward an on-going elementary science partnership including 
both participants from the two years, other elementary teachers, and 
additional resource people from museums, schools, and colleges. 



WORKSHOPS 
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During the academic year folXowiTS^ the program pe**ticipants received a 
-siaall stipend ($160) for participating in the after-school activities* 
Partici pants had been g ranted three rel ease-days by their school t ysteas 
(with substittite teachers paid by the schools). As part of cm* goal to 
introduce them to new resources and to develop leadership skills » they were 
asked to use two of the days at our workshops and the third at a 
professional meeting they would otherwise not have attended* Although ve 
used a number of sites during the two years to introduce participants to 
new resources, we wora never able to make effective use of the Resource 
Center at the Hitchcock Centf^r for the EnvironmcTit as a meeting space 
because of its limited capacity (25 in the largest meeting room)*^ 

AdmiKistrative Smwestions : Regular i*ollow-up activities for Fimmier 
institutes are essential* both to renew the spirits of ail the participants 
and to reward^^thbse who have tried new classroom projects* In retrospect* 
however, ask^jog tho^ participants to design, cafry out, ?md ^*eport on a 
classroom project would have strengthened the prog?'amv We now include that 
component in sll Partnership institutes, ^n factt we now include i whenever 
possible, a one-week second summer institut'5 tr prv>Vide a sense of closure 
to projects and to help participants starv more sophisticated projects. 
The leadership training projects which were tested in NSF/PIES (and which 
will be described in the next section) have led us to a much more 
sophisticated understanding of the long-terpL cummixment any teacher 
enhancement project must make to its participants* J 

( 
I 

WORKSHOPS FOR PRINCIPALS j 

The teachers who helped write the NSF/PIES proposal believed tha^ one of 
the major problems. In improving science teaching was lack of adslinistrative 
support* The recently published NSTA 4-volume series. Promoting Science 
Among Elementary School Principals , confirmed their belief tha^^; such 
support is both essential and cdmpleX^* During the project we tried the 
following approaches to iTiproving a\2ministrative support in our 
participants* schools; 

workshops for all participants In ♦♦Managing Up" so that teachers 
cotild help administrators be supportive; 

workshop/reception for participants and their principals to 
Inlfroduce the prihcipals to the types of activities and the 
philosophy of inquiry science; » . . 

workshops specifically for principals (this series, was plagued by 
Ice and snow storms and was very poorly attended); 

regular personal communication between the travelling KSF/PIES 
resource teacher and the building principals; 

regular personal communication between the project administrator and 
the superintendents &bout the project and the specific activities of 
teachers; 



12 

NSF/PIES Final Report page 9 



discussion with participants . luring academic year meetings about 
problems and solutions i:o administrative support issues (an oral 
history of foolish behaviors and successftil strategies)* 

Although ve were disappointed that more principals did not attend^ oxir 
afternoon seminar series (and that those vho did come needed it the least }» 
we realized that their behavior was hardly surprising. Such a series is, 
by definition, threatening {**You are invited because you are not doing a 
good job.**). Other more informal, and less threatening, approaches were 
more successful.^ While we cannot claim to have influenced the actual 
behavior of principals, we do know that the participaints stopped vieving 
their administrators as the reason for the problems in science teaching* 

Administrative Sujggestions ; It is clearly vital to keep building 
administrators, supervisors, and others in positions of authority informed 
about successful teaching methods and how they can support them more 
effectively. Finding the proper vehicle (workshops offered within their 
own professional organi- ^tion, personal conversation, opportunities to 
observe within their o'^tj and other school systems, for example) is a 
challenge. It is equally important to give tenchers the coi^idence to ask 
for support and the skill (non-threatening, win/win strategies) to secure 
it^ 



EVALUATION 

A complete copy of the final evaluation appears as Part II of this report. 
The evaluation strategies we' used included: 

simple questionnairss distributed and collected at the end of each 
component (Spring Saturdays, each Friday during the summer, each 
release-day or after-school workshop). Questions were: How will you 
use what you learned? In retrospect how could the day /week have been 
better? What should we consider in our future planning? The answers 
were used by the staff for immediate planning; 

personal interviews (based on the Concerns Based Adoption Model, see 
Part II for explanation an.d references) of all participants ^t the 
beginning, middle and the end of the year and classroom observations 
^ during the spring of the year. The results were used to adiust the 
second-year program and to plan other Partnership programs; 

some additional data sources including questionnaires to parents and 
intervieivs with staff. The results were used by the evaluator to 
enrich his understanding of the project. 

There were a number of advantages, and one problem, with our system. The 
advantages, which, greatly outweighed the problem, included: 

for staff: easy access to quick, simple planning information; 
periodic access to sophisticated information on the effects of the 
institute in the classrooms; personal access to the evaluator wb^. 
participated in planning meetings and helped us understand the 
implications of the data; 
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for participants: our rapid response to participants suggestions 
demonstrated oiu* respect for their ideas; the interview-observation 
process reinforced the statements of the teaching staff that using 
the inquiry approach to teaching science was difficult, that it 
would take time to feel confident, but that the confidence would 
eventually come. 

The problem was that we collected too -much data and, therefore, were always 
behind processing it. This is exactly the same problem (trying to do too 
much) which we encountered in both the science and writing con^pbnents and 
one^ which we believe we have solved (at least for the evaluation component) 
in our present National Science Foundation space project for middle school 
science teachers (NSF/SpaceMet ) by limiting the amoimt of data and setting 
more frequent deadlines for reports. 

Administrative Suggestions : Both the quick-and-dirty evaluations of events 
and the long-term evaluation of the impact of the project are necessary, 
i.e. 9 both formative and summative evaluation. In the perfect world there 
would be a variety of spurces, appropriatel7 analyzed, and provided to the 
staff in a timely fashion. In the real world, it. is vital to have some 
data» even if it is less than perfect, regularly. 

The Concerns Based Adoption Model is especially appropriate x'or projects 
which expect real change In classroom teaching. It is possible to use this 
evaluation technique at a number different levels of sophistication 
(written questionnaires only, personal interviews, and/ or classroom 
observations) depending on the needs of a project. 

It is vital that the evaluation be planned before the project begins (even 
if improvements are made later) and that, the evaluator serve as a full - 
member of the planning staff throughout the project. 



CONTINUATION 

SCIENCE/RESOURCE WORKSHOPS 

In the spring of the second year, NSF/PIES began offering a .series of 
workshops for both the participants and other elementary school faculty 
interested in strengthening their teaching? of science. Using staff and 
participants as presenters, we begau a series of self-supporting workshops 
which we hope will continue for many years to come. This past year, we 
expanded the presenters to include other school, college, and museum 
personnel. Since all presenters at all academic-year Partnership events 
donate their time, we were able to charge a $20 fee for release-day 
workshops to cover the cost of food and materials and to offer The after- 
school workshops free of charge. This year's events will include training 
in the chemistry kits developed at Mount Holyoke College, a release-day 
workshop devoted to techniques for using plants in the classroom, at least 
one workshop on professional opportunities such as EarthWatch, and training 
for elementary teachers in using our electronic bulletin board. 
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Administrative Suggestions : If; science programs are to improve, teachers 
need on-going support in locating' new resowoes* Even teachers who have 
participated in programs such as NSF/PIES, have neither the time, nor tie 
self-confidence, to call school college faculty they do not know 
personally to ask for assistance* On-going workshop series providjB a low- 
risk environment for encouraging teachers to use new resouTces* The 
commitment to the participants, and their school systems, must extend well 
beyond the final date of the grant. 

LEADERSHIP Fining 



During the first academic year, it became obvious that participants needed 
more suppot"t than we had initially planned to provide. It was not that 
they were not doing as, well as we had anticipated; they were doing better. 
They were being successful* in their ^classroom and were ;aow ready to^help 
others. Since we had not included a one-weeli second summer institute (as 
we do now), we explore^d five alternatives during the next two years. 

Curriculum development teams in which 10 NSF/PIES graduates 
completed projects they had worked on diiring the school year so that 
they could.be shared with others. (This project was frankly not 
very successful*. Without a staff member of organize the teams, the 
work cbmpleto^ waa personally ^^satisfying, but not as useful to 
others as it could have been* With proper leadership this could 
have been a more valuable experience for the participants and their 
colleagues.) - , 

Follow-up workshop/ seminar focusing on scientific reasoning lead by 
Co-director Richard Konicek. This was an extremely valuable' 
experience for the 8 participants who, working with children, were 
challenged to become teacher-researchers observing the studen'^.'s 
thinking processes (Watson and Konicek, 1990). 

Support for participants who wanted to give presentations to other 
teachers. We sponsored a number of workshops in which participants 
could give prei^entations, sent participants to regional meetings to 
make presentations, and helped them^prepared presentations, posters, 
and papers through individual assistance and a seminar teries 
"Letting Others Know." 

. / 

Selection of individual participants as staff in the second year of 
NSF/PIES and in our middle school science project, NSF/SpaceMet. 
Nomination of participants to special opportimities (Massachusetts 
Lucretia Crocker Scholar; NSF/ Operation Physics team iaember). 

Invitations to participants to serve as participants in, and 
planning members of, other Partnership projects. 

At last count 81 of our original 92 NSF/PIES participants still have 
teaching positions (3 have retired because of age or ill health, 2 are 
teaching outside the state, 6 have lost their teaching positions because of 
state budget ci^tbacks). Of those 81 ctill in our schools, *w49 are actively 
involved in Paritnership activities (26 in leadership roles); we know of at 
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least 10 others are actively involved in. other professional activities 
outside the Partnership; at least 30 have continued to use the resources of 
the Hitchcock Center. Both the Hitchcock Center and the Partnership 
regularly receive inquiries about fut:7ra programs in elementary s::ienco. 
We are very pleased with tHese results* 

Administrative Suggestions ; We are very fortunate that the Five 
College/Public School Partnership as on ^organization will continue for many 
years b^eyond the NSF/PIES grant. It is, therefore, pocsible foi* ue to 
offer on-going support to participants in both science education and in 
leadership training. Gomehow, al?. teacher enhancement projects must 
acknowledge and accept this responsibility. In the long riis it is this 
on-going^ support which ^will surely make the difference between having just 
a happy memory and having strong science prdgrams in our schools* 
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Publications: 

Watgon§ Bruce and Richard Konicek, ••Teaching tor Conceptual Change: 
Confronting Childrien' a Kxpepie Phi Delta K a ppan > May 1990. ppf680r685. 

Laffond, Wanita Sioui, ^Who Me, Teach Science?** submitted to Tegcbe r 
siagazine* 

Herle Bruno, Richard Konicek, and Thomas Wolf are ccxcple'ting articles fox 
su*3aission« 
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NSF/Partnership in Elementary Science Staff 

Co-directors 

Merle' Bruno, Nai:ural Science, Hampshire College 

Richard Konicek, School of Education, University of Massachusetts 

Science faculty 

Mary Gugind, Holyoke Elementary Schools {second year) 
Wanita Sioui Laffond, Buckland-Shelbwne Elementary School (se^^ond 
year ) 

Peg McDaniel^ Librarian, Hitchcock Center for the Environment (both 

years X ^ ' 

Susan Mi t chilli, ^ Amherst Elementary School Science , Coordinator (first 

. year.) . , ^ 

Karen Pedersen, Resource Teacher, Hitchcock Center for the 

- Environment. ( both academic yeai^s , second, siamner ) 
George Smith, Science Department Chair and Woodroy Wilson Master- 

Teacher, ^ South Hadley High School (first year) 
Terez Waldoch, Wildwood School, Amh-^rst (both years) 

Workshops for Teachers {♦vZ^n-aging Up'*) and Principals on Administrative 
Support ^ - ^ 

Gwen Van Dorp, Associiate Superintendent, Mohawk Trail Regional 
Schools 

Consultants on Process Writing 

Marna Bunce, Amherst Public Schools 

Marilyn Gass, Psychology/Education Departiient, Mount Holyoke College 
Charles Moran, Writing Project, University of Massachusetts 

Evaluatpr 

Thomas Wolf, Associate Superintendent, South Hadley Public Schools 

Project Administrator _ - 

. Mary Alice B. Wilson^ Coordinator, FiVe College/Public School 
Partnership 
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1987 and 1988 NSF/PIES Fellows 

Agawam: Aim Bradford, Barbara Daubitz 
Amherst J Richard Borman, Barbara. Rjrnerson, Louise Stark, Debbie Teece, Lisa 
Yaffee . * 

Ashfield: Poppy Doyle, Katherine First, Budge Litchfield, Debbie Rpbidoux 

Belchertovn: Deborah Jacobson, Sherry Sajdak,. Cindy \^ite 

Bernardston: Diana Campbell 

Buckland-Shelburne: Vanita Sioui Laffond 

East Longmeadov: Louisa-May Bouchard, Diedra Paczkowski 

Goshen: Rita Horn 

Granby: Maureen Bail, Louise Cox, Betsy Dickinson, Claudette Finck, 

Patricia O'Neill, Margaret 0' Sullivan, Shirley Pion, Betty Rice, 
Dretta Weaver ' ^ 

Great BarringtonT Coreen NeJame 

Greenfield: Ionise .Petrin - . * ' . 

Hampden: Gisela Leven 

Holyoke: Marguerite Buskey, Thomas Cadigan, Cecelia Cauley, Julianne Deni, 
Patricia Eagan, Maryellen Fisher, Sylvia Galvan, Carole Gamache, 
Teresa Greenwood, Mary Gugino, Mary Kay Haller, Mary Haradon, Joanne 
Lamoreaux, Christine Leary, Catherine Long,, Judy McGinty, Jody 
McNally, Gwen Morrissey, Debra Sicilla, David Zuccald 

Lever ett: David Hammond 

Longmeadow: Grace Hayden, Kristina Gagne, Paula Lewia,^Nina Skojskj/;^ Ina, 

Tober ^ ^ ^ 

Ludlow: Betsy Koscher, Lenore Paul 
Northampton: Phyllis Bouthilette, Joanne Parsons 
Northfi^ld: Laura DiBari 

Old' Dperfield: Mark Foley, Donna Patterson, Irene Woodard 
Pittsfield: Kerry Campbell Ross, David Cooper . 
Shutesbury: Elinor Saltz ^ 

South Hadley: ^uby Costa,,^ Bonnie Crowe, Bob Fitzgerald, Jane Golob, Tom 
Kennedy, Barbara LaCorte, Sandra Manijak, Deborah O'Brien, Peggy 
Murphy-Richardson, Margaret Riddle, Marilyn Simpson, Nancy Sinclair, 
Janet Smith, Eugene Turcotte 

Southwick: Nancy English, Joyce Zippe , , i 

Springfield: Gail Healey, Judith Schwabe, Linda Wilson 

Williamsbiurg: Kathleen Chlanda, Pamela Lamcind, Patricia Lessie, Diana 
Rutherford 
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INTRODUCTION 



"Encouraging, the class to construct paper airplanes 
in the classroom was not the kind of science 
experiment I would .have expected ^to be investeql in. 
Yet these were the experiences in which the .class 
became the most actively involved, and for which we 
received the most positive feedback... my learning 
was a direct result of the risks I took in assuming 
the role of facilitator as opposed to instructor* I 
also learned that ownership is important in science 
process... ov/nership of ideas, conclusions, and projects 
seems to^^gtimulate investjnent and interest." 

"I am encouraged to say that I have a new insight into 
how I can teach science in a way meaningful to my 
students. Using the assigned .text book series selected 
by our curriculum committee, I have for six years been 
unsure about what my students were' learning. The past 
three weeks I have a ^better idea about what has worked 
and what I would like to change. I see the tremendous 
value of teaching science -^through inquiry, jThis method 
along with a valid writing program involves the students 
in their learning far more than textbooks. " 

"PIES motivated me to seek out courses designed 
especially for teachers concentrating on how students 
learn. Cooperative learning groups are blossoming in my . 
classroom in math and science... I feel I have become a 
';professionaV' in teaching. At the same time I'm still 
learning. " 

These quotations are from NSF PIES Fellows and reflect 
the strong feelings that participating teachers have for the 
project. While NSF PIES originally was funded as a two year 
project, it was extended into a third summer and still 
attracts Fellows to school year meetings held through the 
Five College Public School Partnership. Clearly, the project 
has been very successful in meeting its major goals. 
Teachers currently are using hands-on inquiry science in 
their classrooms. They have materials and resources that 
they didn't before. They feel more confident about teaching 
science. More important, they feel comfortable with the 
inquiry process arid responnding to student questions for 
which they are not the source of all right answers. They 
have established informal networks of colleagues which are a 
source of intellectual stimulation and support. While most 
of the teachers speak of disseminating Ideas and materials 
informally, a number of them have received grants and 
fellowships, some of have gone on to graduate study in 
elementary science education , ^others work as staff members 
for SPACEMET which is another NSF funded science program 
sponsored by the Five College Public School Partnership. 
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The remainr\.r of ^hit^ report is dividied into two 
sections. The first is a summary report which looks at NSH 
PIES as a successful staff- development project and anaTyzes 
the reasons for its success. The second is a series of 
presentations and. discussions for i^aoh major data source used 
in the process. All of the questionnaires and interviews 
protocols are included in the Appendix One. Appendix Two 
includes the criteria used by the people who -^ade the 
classroom observations for the project, r'^pendix Three^^ 
includes a full chronology of project events.. 
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SECTION ONE 

NSF PIES as a Successful Staff Development Program 

There are some key indicators of the NSF PIES' Project 
success as a staff development program in elementary science. 
Two years after the NSF PIES Project funding has ended, the 
Five College Partnerhisip helps to design follow-up activities 
for the Follows and other elementary teachers interested in 
science curriculuin and the inquiry method. Both first and 
second year Fellows remain active in science education in the 
area in a variety of- ways. Individual: school districts have 
increased their support for elementary science and .the 
inquiry method withip ^he constraints of prpblematic^state, 
and local budgets. There are some good" reasons for*€he 
program's success^ none of them surprising. NSF PIES 
exhibits important characteristics of a successful program; 
and the rest of this section looks at these programmatic 
features. 

A number of specific featUlr:es< of successful staff 
development programs which can be mentioned here and which 
. are mentioned often by the -NSF PIES Fellows are important 
strengths of the projects ^ ^ 

First, the NSF PIES staff was experienced ih both 
working vyith elementary teachers and inquiry 
science. Most had experience teaching science to 
elementary students. Staff responsible for process 
writing had the same important experience. 

Second, there was plenty of relevant content. Tfie 
content was practical, teachers could use it their 
classrooms, it fit their curricula and 
developmental needs of their students. Moreover, 
the content came with the theoretical and 
methodological underpinnings which would enable the 
teachers to incorporate it as part of their - 
teaching style and not just as someone else's 
recipes. 

Third, there was enough follow-up. Not only were 
there meetings throughout the school year, but a 
staff member was avai lable-for any teacher who 
wahted assistance on-site in his/her school. 
Teachers were given memberships to the Hitchcock 
Center and access to the Center's materials and 
consulting help when they cam^e to look for 
resources. Moreover, follow-up was available in 
the Year Two summer for Year One Fellows in the 
form of curriculum development stipends and in Year 
Three summer for both sets of Fellows in the form 
of an additional course. 



ERLC 



NSF PIES Final Report 

23 ^ 



4 



4. 

Fourth, there has been ample and varied time for 
collegia! interaction. Planning groups met 
regularly during the summer to plan for the 
practice teaching in the Mass Migrant Education 
Program, and support each other's learning. Follow- 
up meetings during the year gave Fellows both/ 
structured and unstructured time to share their 
experience. Meetings of interested Fetlows to plan 
project activities also gave those people involved 
in the planning additional opportunity for sharing. 

Finally, although it is not mentioned as often by ^ 
Fellows, the project helped them by involving their 
administrators and showing them how to "manage up,*' 
enlist the support of building and district 
administration. 



While the evaluator feels these specific characteristics 
are necessary for successful staff development programs, he 
sees a set of principles which need to serve as part of the 
framework in which any subjoct-oriented staff development 
program must set. 

1 . There is a clear, shared vision of educational goals 
and bhi losophv . Much of the effective schools research 
points to the need for people to understand and commit to a 
shared set of x^alues and goals. Most of the iiSF PIES staff 
came to the project with ektensive experience in and 
commitment to hands-on inquiry science. Merle Bruno had been 
one of the early curriculum developers for ESS. Richard 
Konicek had been operating both undergraduate and graduate 
programs in science educations based upon a con^structivist 
point of view. The staff at the Hitchcock Center had 
previous grants in teacher training from NSF which were 
focussed on the same kinds of curricula and methodology. Two 
of the staff members from, the schools had previously run NSF 
teacher training projects in ESS materials for their peers. 
The planning for and implementation of the project was 
informed throughout by a sirnilar point of view. Thus, the 
NSF PIES Fellows consistently received the same implicit and 
explicit message. In addition, while the Fellows differed 
in their experience with inquiry science and their teaching 
settings, they all came as elementary teachers having made 
the commitment to learning more science theory and classroom 
practice. 

Differences in this shared vision produced some of the 
more problematic moments in the life of the project. Initial 
planning meetings brought together university and school 
people, writing and science people, and urban and small 
school district people. There were some strong differences 
between the writing and science people even though thiB 
planners assumed that process writing and inquiry science had 



O NSF PIES Final Report 



5 



their roots in common assumptions about learning and how 
students construct meaning. Moreover, data from the project 
seem to indicate that it was not possible to convey the depth 
of purpose and vision about both discipline areas. While 
some teachers report that they are integrating writing with 
science, the success of the project is better indicated by 
the number of teachers who are implementing inquiry science 
by itself. 

It is intereGting to note that there was some confuf^ion 
on the part of the Year One Fellows as to what inquiry 
science was. Some understood it as providing students with 
active "hands-on" learning experiences. Others knew that 
hands-^on activities were just a piece of a larger "minds-on" 
process which involved^ students in generating questions for 
study, developing experimenxial situations, and drawing 
conclMsions from the data gathered from these experiments. 
When this confusion emerged from the data in Year One, there 
was agreement among Project staff that summer workshop and 
school year activities needed to be redesigned to directly 
address the confusion between "hands-on" and "minds-on" 
activities. 

Differences, between urban and sjnaller school districts 
surfaced both during the planning, process and the first 
summer. Needi* of teachers, system resources, flexibility of 
bureaucratic response were issues that'highl ighted the 
differences between urban and rurel/suburban schools during 
the planning process. The^diff erent school system norms and 
needs proved to be problematic. Early in the first summer, a 
serious spl it .developed between some urban and small system 
teachers around issues of multicultural education and dealing 
with diversity. Some small district teachers dismissed the 
distinctive needs of minority students. ' Project staff dealt 
with this insensitivity and the resultant anger for most 
Fellows; but, the residue adversely influenced a few Fellows' 
commitment to the project. 

These issues raise interesting questions. Staff 
development programs must model and hot just preach the kind 
of learning environment they hope to have teachers create for 
their students. Is it possible to maintain both a shared 
vision and the kind of heterogeneity that makes for a rich 
educational experience? If the research is seriously 
questioning both the effectiveness and equity o1^ homogeneous 
grouping with students, how can educators design such 
programs for themselves? 

The evaluator feels strongly that differences in 
experience and needs does rot have to interfere with having a 
shared vision. In fact, the NSF PIES Project worked through 
the issues listed above; and, the program was very 



ERLC 



NSF PIES Final Report 

25- 



^6 



successful. What is required is a reaffirmation of the 
values and assumptions abou'^ learning and growth that brings 
people together. . 



2. There is a theoretical model which mi rrors the ways 
in which teachers wi 1 1 first encounter, Ipegin to mastev*, and 
sha re the ideas and activities with 6the>^s. The Concerns 
Based Adoption Model is good way of conceptualizing the way * 
in which teachers first encounter and then adapt an 
innovation for their classrooms. A full explanation and 
citations for CBAM appear in Section Two. Briefly, CBAM 
holds that a teacher moves through a process of: 

learning about an innovation; " 
planning to use it; 

beginning use in which he/she is mostly 

concerned about how it works and management; 

becoming comfortable with it and- gradual ly 

adapting it to jnaximize its effect on students; 

and, sharing his/her experiences and learnings with 
colleagues in developing new directions based upon the 
innovation. ^ ^ 

An outline of the project's four years (three NSF funded 
and one locally funded) shows th-;)_m6del of learning and 
growth. 

Year One - There was a major emphasis on hands-on 
science and becoming comfortable with what that 
looks like and feels like in the c^icssroom. Follow- 
up work was focussed on collegial sharing and support 
and on curricular extensions. 

Year Two - The project cqmbineds hands-on and minds-on 
science into a more comprehensive picture of inquiry 
science for teachers. In addition, Year One Fellows 
worked during the second summer in beginning 
dissemination activities of writing curriculum for 
distribution to peers. Follow-up work was focussed on 
minds-on science, collegial sharing, and an increasing 
emphasis on different forms of 'dissemination. 

Year Three - The summer work moved into a more complex 
process of analyzing how students construct scientific 
meaning, how they develop scientific misconceptions, 
and how classroom experiences might be designed to 
challenge these misconceptions and move students to 
a more accurate understanding of scientific principles. 
Dissemination included participation in regional 
and national conferences. Some of the Fellows moved 
into graduate programs, staff positions in otb/5r staff 
development programs, and science resource people for 
either state grants or Istrict programs. 
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Year Four - Pissemination activities continued through 
graduate programs, individual Fellows' work, continuing 
workshops and meetings throughout the year, 
presentiations at conferences, and articles. 

It 1§ also interesting to note that the program's 
increasingly complex programs and widening perspective 
roughly parallels Bloom's Taxonomy of Cognitive Objectives. 
Activities ir> Year One can be seen as focussing on 
understanding the concepts, of inquiry science and beginning 
to apply them in the classroom* Year Two continues the 
process of application and begins to analyze the nature of 
inquiry sqience,. The summer program in Year Three involves 
Fellows in analysis of how students construct scientific 
meaning and the synthesis of that knowledge that will enable 
them to design activities and^programs ba§ed updn the 
students' construction of knowledge. Throughout the project, 
there is a grovying emphasis on evaluation which can be seen 
m the increasingly complex dissemination and support 
activities. 

The evaluator does not subscribe to the idea that the 
taxonomy is a rigidly chronologice^l set of stages that all 
people must go through or tha^c higher levels are necessarily 
better than lower ones. However, the successful CBAM 
research in the stages that teachers go through as they adapt 
innovations haa been applied to thoughtful work on how to 
design successful staff development interventions based upon 
the stages. There are definite parallels betw^^q the two 
models in the increasing levels, of complexity and widening 
sense of perpective. The NSF PIES design has both the 
increasing complexity and widening perspective; and, the 
evaluator believes that future NSF programs should consider a 
similar developmental model in developing long range plans. 



3. Teachers need to be treated as theoreticians as wel 1 
as practitioners and an effective staff development program 
must be a mode-l of the ref lecci ve process it encourages its 
.participants to £0 through. One often hears teachers talk 
about successful workshops as those which give them things to 
use in their classrooms. "Make and take" has been a phrase 
used to describe experiences which fill teachers' hands with 
things to do. The evaluator agrees that a consultant needs 
to: establish credibility by knowing what will work and what 
will not in the classroom; that teachers need to be able to 
use a wide variety of materials and activities; and they 
don't have the time to research or develop the full range of 
materials and activities that will add to their 
effectiveness in the classroom. However, unless teachers 
understand that they are constantly engaged in actioh 
research, that their choice and modification of materials is 
a reflection of their values and assumptions about learning 
constantly at work, and that becoming conscious of that 



ERLC 



NSF PIES Final Report 

27 



8 



critical eye will deepen and enrich their teaching, the 
materials they prize will quickly lose their appeal and 
become old stuff to them and their students.. However, if 
teachers can recognise the assumptions about learning 
important to them and understand how they can test their 
espoused theory against their theory in action, they will be 
in control of the materials they use and not vice versa. 

The NSF PIES Project was an excel lent -examp^^le- of a 
reflective model. It made several important adjustments from 
Year One to Year Two based upon the Fellows' feedback. It 
involved them |n the evaluation and planning for all the ' 
follow-up activities and used them as presenters at a number 
of the follow-up meetings. NSF PIES staff actively recruited 
Fellows to design and deliver presentations at regional and 
.national meetings. Year phe and Year Two Fellows saw the , 
ways in which the summer program developed as they pushed at 
the concepts of hands-on, inqutry science ^ind constructi vist 
theory. Finally, the project designed a great many 
activities which involved teachers in collegiul relationships 
around, the cycle of planning implementation, evaluation, and 
redesign or. reaff i riratipn.- Thus, the Fellows not only saw a 
reflective model at work but had the opportunity to \ 
participate in the model at every step of the program^. 



4. An effective staff development program must have some 
of the characteristics of a temporary system, or be able to 
operate as vf it wer^ a part of loose'iv coupled system, whi le 
sti 1 1 maintainirfq efficient organization and communications 
. mechanisms. Teachers' lives are beset by bureaucracy, 
schedules, and other people'agendas (district curriculum and 
teachers' guides, community norms, etc.) Moreover, the 
rationale for staff developi^ent programs most often center on 
manipulating teachers in some way that will produce better . 
students. Effective staff development programs use the 
characteristics of temporary or loosely coupled systems to 
treat teachers as peop'ie in their own right, as 
people who have individual goals for their own evelopment as 
adult learners, who come together as a community of 
professionals around a body of theory and practice in which 
they are interested and have expertise. 

The major features of a temporary or loosely coupled 
system are that it is outside the customary bureaucracy and 
bureaucratic control and hierarchical structure, that it is 
flexible and responsive to the needs of the participants, 
that the substance of the system lies outside the 
bureaucratic structure and is meaningful to the participants, 
and that the participants feel empowered as co eagues and 
deci si on-makers . 

The evaluator fe«3ls the NSF PIES Project has been such a 
system. 
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First, it has been organized through the Five 
College Public School Partnership, an organization 
that is not tied into local or state bureaucracy. 
Moreover, each school system had to agree to 
support participating Fellows by releasing, thern 
three times durjng the school year in order to 
participate in follow-up activities. One of the 
features of the project is that leadership has come 
from both staff members and Fellows, with school 
^ teachers sometimes serving- as stiaff members and 
. working col l^borati vel-y with universfty or 
* Hitchcock Center staff. The logistics and creature ; 
comforts for the summer workshops and follpw-^up 
sessions were well planned for and not 
characteristic of the usual staff development 
. programs. ... ^ " 

Secood, the project was definitely responsive to 
Fellows' needs. Feedback was actively and often 
asked for, and program changes were made in direct 
response to Fellows' suggestions. Fellows were in 
on all -the planaing as soon as the project began to 
function during the firsts spring. \ 

[ 

Finally, NSF PIES offered teachers substance that 
was important to them: a philosophy for^ teaching 
science, background science knowledge, and^ ^ 
curriculum kits and activities that bring the 
philosophy and knowledge to >ife for students. 
Moreover, the philosophy, a vision of inquiry 
science, was never diluted with other agenda. In 
fact, it became stronger and more clearly 
articulated as the projfect grew in years two, 
three, and four. Most important, the Fellows were 
not treated as people to be remediated but as 
professionals with the experience and expertise to 
participate with colleagues in the ongoing 
development of the program. 

It must be said here that the Five College Public School 
Partnership, le outside the customary bureaucracy, 
nonetheless was able to provide the necessary. logistical and 
communications support for the project. There were few, if 
any logistical problem?. Communication was timely and clear. 
It could have just as easily become a problem with the 
Fellows spread but across a number of member districts and 
schools. Thus, the project .was able to maintain its^ 
character as a temporary system without sacrificing 
organization necessary to keep people informed and 
interested. 



Data show that the NSF PIES Project achieved its major 
goals. The NSF PIcS Project success can be attributed to the 
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lact that teachers came away from the experience feeling :hey 
had gotten ideas and activities to use in their classrooms; 
that they have a better background in science and more 
confidence in teaching it; and that they better understand of 
the inquiry process and hbwto incorporate it in science and 
other subjects. The data contained in cjuiastionhai res, 
classroom observations and interviews validajie these 
conclusions. However, the evaluate r feels that it is the 
larger context of a staff development program which engaged 
teachers as adults and- empowered them^ as professionals which 
wiM be responsible for the lasting impact of the project. 

Empowerment or engagement are current buzzwords on the 
educational landscape. They imply a different kind of 
educational reform rpovemenj; than the top down, mandated^ 
reforms that followed reports such as A Nation at Risk ^ ^ 
In this scenario, the teacher i^ a reflective practitioner, a 
researcher who has a responsibility to build <;urriculum and 
test his/her ideas in the classroom. The teacher is a 
prof es3ion»il colleague with resp.onisibility to the other 
teachers with whom he/she works. The teacher is an adult 
learner who can sensitively translate hi.^/^er experience as a 
learner into meaningful experiences -^or students. 

The NSF PIES Project provided a staff development 
program consistent with this model of educational change. 
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SECTION TWO 
DATA SOURCES , 

Level of Use (LoU) Interview 

L6U Process 

The LoU Interview was developed as part of the Concerns 
Based Adoption Model (Hall, Wallace, and Dossett,, 1973,). 
(Hall, Loucks, Rutherford, and Newlove, 1976), (Hall andl^^ 
Ebucks, ^9J7) (Hall and Loucks, 1978 )• The central theory is 
that teachers go through a developmental process as they 
adopt any innovation* These stages are as follows (Loucks, 
1977): ^ ^ . 

4). Non-Use - No action is b-^ing taken with respect to 
^he innovation. The user (teacher) has no 
Knowledge of J.t. ^ . 

I. Orientation - The user (teacher) is seeking ^ 
information about the innovation, how it works^ 
what pei^onal impact ijb will have, etc. 

II. Preparation - The user (teacher) is preparing to 
use the \ innovation, has set a definite date. 

Mechanical - The^ usef* (teacher) is implementing 
the innovation i'n a poorly coordinated manner, has 
management and logistical questions. 

\ \ 

Routine - The user (teacher) is comfortable in 
u$iing the innovation, is making* few or no changes, 
and has an established pattern of use* 

IVB. Refinement - The user (teacher) is making changes 
in his/her use tx> enhance student outcomes. 

V. Integration - The user (teacher) is making 
deliberate efforts to collaborate with others in 
using the innovatioii. 

VI. Renewal - The user (teacher) is seeking more 
effective alternatives ^;o the established use of 
the innovation. 

In the case of the NSF PIES Project, implementing hands- 
on inquiry science in the classroom was established as the 
innovation. 

For each of the two years of the project, the evaluator 
attempted to interview the NSF PIES Fellows who were 
currently engaged in teaching^ scienbe in their classrooms in 
the Fall and the Spring. He did net interview Special 
Education Chapter One, or remedial reading teachers Who did 
not teach science regularly while. One teacner each year 
became ill and, missed a great deal of school.. One teacher in 
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the seopnd year of the program left teaching. For the 
remaining teachers, the evaluator sent them a letter which 
contained a series of dates, a form on which they could 
indicate three choices for interview times, a 'stamped 
addressed envelope for return, arid the interview protocol. 
In addition, he followed this letter up wi^th telephone palls, 
to scJhedule those teachers, who did' not reply. For the most 
part, this process , was very successful; and;, m<)st of the 
teachets were interviewed in the fall and . spring 

All of the interviews were conducted by phone. In - 
addition to the LoU questions (see Appendix A) the evaluator 
asked the NSF PIES Fellows the following questions: 

— Has your participation in the NSF PIES Project had 
^ any impact on you as teacher (individuals were asked to 
comment on thei ^nsjwer ).? ^ . ^ 

— wKat would you say are the mcjor strengths of the NSF 
PIES Project? ^ ^ ^ ' ^ ^ ' 

—What would you say are the major weaknesses of the NSF 
PIES Project?^ . . 

- , . / I ' . 

The evalujator looked at the data from thes.e interviews 
in two ways. First, he placed the teachers at different 
Levels of Use according to the interview interpretation 
protocols. Second p he grouped the responses ^o the four 
questions above andl the second LbU Question (What would you 
say are the strengths and we«^knesses of han^s-ore^ inquiry \^ 
science) into general categories. The data from these four 
questions are an important source of Fellows' perceptions 
about the Program and its impsLct on them and their teaching. 

LoU Data. 

Data show that teachers in both years grew in their 
comfort with and ability to adjust to hands-on, inquiry 
science. Table One presents the LoU data for the Year One 
Fellows; Table Two presents the LoU data for the Year Two 
Fellows. 



Table One. 
Year One NSF PIES Fellows LoU 



Fall (n=38) 



Spring (n=:39) 



Level of Use 

0 ^Non-Use 

1 Informational 

II Preparation 

III Mechanical 
IVA Routine 
IVB Adjustment 

V Collaboration 

VI Renewal 



4 (11%) 

12 (.32%) 

16 (42%) 

4 (11%) 

2 (5%) 



2 (5%) 
1 (3%) 

27 (69%) ^ 

6 (15%) 
1 ( 3% ) 



2 (5%) 
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Table' Two. \ 
Year Two NSF nPIES Fellows LoU 

Fall (n=36) Spring (n=:32) 

Level of, Use . 
0 Non-Use 
T. informational 
II Preparation 

ill Mechanical ^ 15 (42%), 4 (13X) 

IVA Routine - ~ 18 (50X) 18 (56X) 

IVB' Adjustment S . J^X) -8 (25X.) 

V -Collaboration .. 2 - (6X) 

VI .Renewal ' ' * . . 

Discussion 



Jn both years, the percentage of teachers 'w^io were 
concerned with management issues declined significantly. In 
Year One, the percentage of teachers v^ho were able to 
establish a comfortable routine and in Year Two, the 
percentage of teachers who were able to make- adjustments in 
their classroom to enhance student learning Increased 
significantly. This growth on the part of the teachers is 
important. When teachers cannot develop beyorid a primary 
concern with management of an innovation, * their use will 
remain mechanical and may eventually disappear. More 
important! their focus cannot be on the students anci what the 
students are or are not learhing-v . 

Other data in this interview substantiate the ^ 
evaluator's feeling that the NSF PIES Project played a ma^or 
role in the Fellows* growth in ^heir use of hands-on inquiry 
science. However, there are two other factors which must be 
taken into account in looking at these data. 

Fiist,^not all teachers came to NSF PIES with 1;he 
same background knowledge or training in science, 
with the same experience teaching or teaching 
science, with the same philosophy about teaching 
and learning, or from the same school system.- Some 
teachers entered the program' with a good deal of 
experience teaching science from this philsophical 
base. Others were to begin teaching science for 
the first time after their participation in the NSF 
PIES Summer Program. 

Second, unless a teacher ' s^ schppl district actively 
supports his/her participation in hands-on, inquiry 
science, the teacher will .find.it difficult to 
maintain his/her energy level and commitment. For 
the most part, the teachers did indicate a level of 
support when they responded to this question in t^he 
Spring. Year One Fellows made 31 positive 
comments, 3 indifferent comm»2nts, and 14 negative 
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comments. Year Two Fellows ni*^de 48 positive 
commentL^ 2 indifferent commesrts, and 7 negative 
comments* Host of the negative comments focussed 
on the lack of financial support. Budget shortages 
could lead to mu,ch larger student-teacher ratios i 
less time available for science in the school. day i 
less money available for staff development, and , 
fewer supplies. All of these factors would 
definitely impact the degree to which the classroom 
teacher could grow in his/her use of hSnds-oni 
inquiry science. / 



Additional Questions 

Next, the evaluator looked at the answers to three 
questions as jneasuz^es of teacher perce^tioris : (1) tlje_ ^ 
strengths and weaknesses of hands-on inquiry science} (2) how 
the^ NSF PIES Project changed them or their attitudes toward 
teaching, and (3) the strengths and weaknesses of the Project 
itself. Tables Three, Four and Five present data about each 
of these attitudes in tui*n. Each table presents the totals, 
differences between the fall and spring interviews for each 
year, and^ differences between each year.^ 

Strengths and Weaknesses of Hands-on Inquiry Science 

Data 

f 

\ While this question is an integral part of the LoU 
Interview, the evaluator felt that the responses would be ^ 
interesting to isolate. Table Three presents the results. 

Discussion 

Iz is an interesting feature of the responses that every 
grouping of the data for strengths show that over 90% of the 
responses are focussed on the 4-mpact that the content and 
approach has on students (students are motivated, students 
learn, students benefit, and non-verbal students succeed). 
These responses are a strong indication that the project has 
been successful in not only introducing teachers to hands-on, 
.inquiry science but in getting them to understand and accept 
the set of assumptions which underlie process science as 
well. 

One of the features of the dat^ is the difference 
between the Fall and Spring responses for Year 2 Fellows* 
There is a lessening of responses (from 51% to 44%) for 
"students learn the inquiry process" and a growth of 
responses (from 10% to^ 21%) for "hands-on is good for 
students." The difference is not significant with the high 
aggregate percentage for both times of the year being more 
important. 
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It is important to note here t^.at only three percent of; 
the teachers mentioned that hands-on > inquiry science, gave 
them a chance to integrate writing into science • The NSF 
PIES Project began with this integration as an important 
goal* During the first yeari more workshop time was directly 
devoted to it than during the Gecoiid# However i there is no 
corresponding difference in the teacher responses. 

While the teachers mentipn the impact on students as the 
strengths of hands-on, inquiry science, they- note managemekic 
issues ^as the weaknesses. Time ;to, fit it in, classroom 
management, finding space and materials, and aSminist/rative 
support consistently represent over 80% of the responses.. 
Three things are important. 

First, the percentage, of responses fo^ time and. 
materials/space are higher^ than those for classroom 
management. Moreover, they increase from "the Fail 
to Spring for both years while the ones for 
manaf^ement decrease (Year One) or stay the same 
( Yea r Two ) . 

Second, the percentage of teachers who are 
concerned about Waluating student progress 
incrtjases markedly in Year Two» 

Third, the percentage of teachers who find no 
we«\kness in hands-on, inquiry science increases in 
bot years — from 9 to 13 percent in Y,eair One and 
frok 3 to 10 percent in Year Two. 

Teacher perceptions of strengths would seem to place 
them at LoU Level IVA or IVB indicating that the project has 
been a success. Teacher perceptions of weaknesses would seem 
to place them at LoU Level III and' indicate they are unable 
to escape wc:;'*rying about management issues. This seemiijg 
contradiction can be looked in two ways* 

First, management issues are in^itfrent in hands-oxi, 
inquiry sciencer Regardless of the level of 
comfort a -teacher has with the process ojr how much 
he/she believes in the benefits for students and 
the validity of the process as a way of knowing, it 
does take more time and require more space and 
materials than a text. In fact; the time and 
materials issues are generally more problematic 
with other important curricular approaches such as 
manipulative math and process writing. It is. 
important to note that teacher concerns about 
classroom management decreased which indicates that 
they are feeling better about their ability to 
implement the process. Concerns about finding time 
in a schedule crowded with other curriculer 
demands, having enough physical space, and getting 
proper materials are out of their controL. 
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Second, the percent^age of teachers in both years 
who found no weaknesses in the process increased 
from the Fall to the Spring indicating that a 
growing number of teachers were feeling better 
about their ability to implement hauds-on, inquiry 
science in their classrooms. 

The evaluator finds the difference in« teachers* concerns 
ab_out evaluating student learning between Year One and Year 
Two interesting. It is consistent with the LoU data which 
show that a- greater percentage of Year Two teachers are at 
Level IVB than are Year On^ teachers. More importanti the 
evaluator feels that the viariat^on reflects a difference in 
emphasis of the staff in its design , of Year Two activities. 
Data from Year One indicated th^at the teachers had focussed 
more on the hands-on aspects of science than the inguiry 
process. As a^resuLt, the NSF PIES staff focussed more on 
showing teachers how inquiry and reflection were necessary 
parts of the hands-on process and how to integrate "mihds-on 
science" into their classrooms, ^his emphasis on reflective 
learning is evident in the difference in the date between the 
two groups of Fellows. 

Impact on Me and My Teaching / 
Data 

The evaluator di^ not ask this question directly to Year 
One Fellows in the Fall. However, enough of their responses 
to other. questions ^could be cha^racterized in this manner to 
cause |iim to ask the question directly in the Spring and to 
Year Two Fellows. The responses are presented in Table Four. 
The evaiuator will discuss the Spring responses for both 
years as they are comparable. 

Discussion 

There were some differences between the two yea^n. The 
most noticeable is that a much greater percentage of teachers 
in Year Two mentioned that they were using the inquiry 
process' more in their teachiilg as a result of NSF PIES. More 
teachers (c\nd a higher percentage) in Year Two also mentioned 
that the*/ felt more comfortable with science than did Year 
One teaciiers. These differences are matched by the 
difference between the two years in the higher feeling of 
personal growth expressed by the Year One teachers. Very few 
teachers in either year talked about either integrating 
writing into their curriculum or teaching writing better as a 
result of the NSF PIES Program. 

It is important for the evaluator to note two things 
about this data. 

First, while differences do exist in the Year One 
and Year Two responses, "using the inquiry 
process," "personal growth in the classroom," and 
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"more comfort with science" i53^y all be indications 
of the same thing; that the project has been 
successful in its major goal of increasing the use 
of hands-on inquiry science in elementary 
classrooms. It is also possible that the greater 
number (and higher percentage) of responses in Year 
Two which directly mention the inquiry process is a 
result of the NSF PIES Staff focussing on and 
articulating the "minds-on" (inquiry) part of the 
instructional methodology more in the year two 
activities. 

Second, as with other data, few people mentioned 
their use of writing in the classroom as an impact. 
The small percentage of responses in this area is a 
result of the project's not having enough time or 
resources to accomplish two very ambitious go.als of 
introducing both hands-on inquiry 'Methodology and 
content and writing into the ele&entary science 
curriculum. In addition, the evaluator believes 
that asking teachers who weren't already 
comfortable with process writing to do both is 
contrary to what reseAx^ch tells us about how 
teachers adopt innovations. 



Strengths and Weaknesses of the NSF PIES Project 
Data ^ 
Table Five presents the data for this question. • 
Discussion 

Teachers felt that the greatest strength of the project 
were the -learnings (process skills^, science content, and how 
to get classroom resources) that they experienced. Other 
responses with comparatively high percentages were the 
collegial experience and the chance to share with peers, the 
NSF PIES staff, and the increased confidence teachers felt in 
the classroom as a result of the NSF PIES experience* The 
most interesting difference between the two years is that 
there were many more responses by Year Two teachers than Year 
One (280 to 75 )• This discrepancy is reflected in the 
different number of responses in areas such as: the 
opportunity for collegial experience, the learnings that 
teachers experienced, the quality of the staff, the 
opportunity to practice their learnings during the summer, 
and the student outcomes as a result of hands-on , inquiry 
science. In addition, a much greater percentage of teachers 
in Year One (37%) did not list any strengths of the project 
as compared to Year Two teachers (1%). 

The most important feature of these responses is the 
fact that 96% of Year One teachers and 44% of Year Two 
teachers did not mention any weaknesses of the project. In 
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fact, responses by Year One teachers are negligible. Year 
Two teachers mentioned the need for more follow-up, logistics 
and organization, and the interface with the Mass Migrant 
Education Program staff and schedule most oftenx(20X). -Some 
teachers were concerned with the fact that there wasn't 
enough science theory (14%). Others felt 'th^ need for more 
grade leved activities for younger sttidents Tl2%). 

The most important feature of this data is that 
strengths mentioned outnumber weaknesses by over- 7 to 1 (355 
to 50). This fact is a strong indication of che .perceptions 
of the NSF RIES Pel-lows of the worth of the program. Also - 
important is the fact that the strengths mentioned indicate 
that the project has fulfilled its major goal (^learnings in 
hands-on inquiry sqience, increased confidence iri^the 
classroom, and student outcomes) and that the program design 
reflects the best in staff development research (the " 
opportunity for cpllegial interaction, a strong staff* the 
opportunity to practice and follow-up new learnings). 

There are some interesting disc^repancies^ in this data. 
While Year One teachers mention strengths about one quarter 
as much as Year Two teachers, th^r mention almost no 
weaknesses. Similarly, Year Two teachers^ are responsible for 
mentioning most of both the streng:ths and weaknesses. The ~ 
evaluator feels this difference is due more to the 
characteristics of the two '.groups of Re Hows and not to their 
differing opinions of the project. 

While Year Two teachers mention the opportunity to 
practice at the Mass Migrant Education Program during the 
summer as a strength, they also mention the interface with 
the program as a weakness. The evaluator feels that this 
discrepancy is an honest appraisal by the Fellows of both the 
opportunities afforded by the Mass Migrant Education Program 
and the difficulties of being seen as a "specialist" by the 
Mass Migrant Education Program staff who had no real 
appreciation or understanding of the- people who showed up in 
the afternoons to teach their students. 

Finally, the ratio of strengths to weaknesses goes from 
8 to 1 in the Fall to 6 to 1 in the Spring for Year Two 
teachers. It is beyond the scope of this evaluation, but the 
evaluator feels that the smaller number of responses in two 
areas: the learnings gained from the project and the impact 
on students should be followed up. 
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Summer Program Questionnaire 

Process 

Copies of the questionnaires used at the end of the 
summer programs can be found in the Appendix* Using short i 
instiruments and informal feedback, Program staff collected , 
data regularly each week which they used to make adjustments 
to the program. The questionnaire used at the ehd^f the 
su^^mer to assess teacher opinion was much longer and was a 
combination of multiple choice and focussed open-ended 
questions about each segment of the program. The^ 
questionnaire's maj'cfr areas of concern were: teacher 
perceptions^ jof their learnings, the relevance of their 
experience and material, and their opinions of the strengths 
and weaknesses of the different parts of the program. 

In retrospect, the questionnaire was much too long. 
First, NSF PIES staff were able to make useful changes in the 
program based upon the day to day feedback they sought out 
and the brief formative instruments they used along- the way. 
Second t much of the information used to improve the second 
summer was gathered in this fashion and through the 
interviews the evaluator conducted during the year. Third, 
the data were repetitive. Asking the same questions about 
each segment of the program produced the same information 
again and again r interesting in the aggregate, but net useful 
fox program improvement or evaluation. 

Therefore, the evaluator has grouped, the data and 
discussion in the following six sections: 

— an aggregation of the multiple choice responses 
used for both years 

— short answer responses of teacher confidence and 
concerns about integrating inquiry science and 
process writing into their classlrooms (Table 
Six. ) . 

— • short answer responses of teacher perceptions of 
presentations and workshop strands (Table 
Seven) . 

— short answer responses of teacher perceptions of 
their work in the Mass Migrant Education Program 
(Table Eight). 

— short answer responses of teacher perceptions of 
the Teacher Resource Center (Table Nine). 

— short answer responses of teacher perceptions of 
their work in the pe'^r planning groups ( Table ^ 
Ten) . 
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— short, answer responses of Year One teacher _ 
perceptions of i;'^elevance of presentations and 
wish for additional information^ (Table FJevenJ. 

It is important to note^ here t^at all the data Ijshow that 
the . summer progrc'^*^ were very successful for: both years. 

Data ' ^ \ 

Multiple Choice Responses > For each workshop strand, 
individual presentat^ion, or piece of the summer program 
teachers were asked how well they thought the segment was 
organized ajid how relevant they thought it was to their work* 
In additioiiV for workshop strands or regular pieces of the^ 
program teachers were asked if they thought they had time to 
gtt their questions answered and if they had enough trinie to 
sh.;re with their peers. The aggregate data appear below. 

This (strand, presentation, segment) was well organized. 

Strongly Agree 222 : 

Agree 131 
Disagree 25 
Strongly Disagree 3 
No Opinion 1 

This (strand, presentation, segment) was relevant. 

Strongly Agree 204 

Agree 125 

Disagree 50 

Strongly Disagree 8 

NoT.Opinion 5 

This (strand, presentation, segment) had enough time for 
my questions. 

Strongly Agree 137 
Agree 83 
Disagree 2i 
Strongly Disagree 3 
No Ppinion 0 

This (strand, presentation, segment) had enough time for 
me to share with colleagues. 



Strongly Agree 114 

Agree 79 

Disagree 14 

Strongly Disagree 2 

No Opini"*^n 1 



Discussion. The data from the multiple choice responses 
are o >rwhelmingly positive. The profile for each response 
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--- N . fableJix,.. A 

Major Frojecc Goals oi^tegratiDg Inquirj Science 
afilProcess griti&g in Classroots 
Teacher FerceptioDS oi'.ConfideDce .and Concerns 
^ ^ Supers One and Iio 

Toial !ear One !ear fvo 

Integrating inquiry science ^ ^ 



r feel confident that 



I vill use inquiry sciesce 


61 (m) " 


- i{ m] 


27 {52t) 


I ae coBfbr table vith it 


32 


231304) 


9 (m) 


Stndents fill respond 


il { i\) 


3{«) 


8 m) 


I have increased resosrces. 


n {i3») 


12 (161) 


5 (101) 


I havr ^ecofie a better teacher 


1(1*) 


•0 


1 ( 1\) 


I have be:oBe„a better 


2 { 1\] 


0 


. 2 { «) 


obserTer of students 








I sill share this expeiiecce 


5 { «) 


5 { i\) 


0 


X3 response 


4 


4 


c , - 



I ha?e cor.cerns about 



change vil! be hard 


IC (12*) 


6 (141) 


4 :{10*) 


Integrate' for Spanish 


3 { «) 


i{2») 


2 { 51) 


speakers 








HoH to, use in SPED rooa. ■ • 


i{U) 


C '< 


1 { 2i) 


Tice, ^Banagexent 


30 (36t) 


15 m) 


15 (m) 


Budget, caterials 


20 [U\) 


11 (26%) 


9 


District carriculas fit 


M 54} 


2 { l\) 


z 2 (Si) 


I sill becone unootivated 


6~ { 7*) 


1 { 2t) 


v(m| 


1 siil eiclude other things 


i(U) 


"0 


r{ 2*1 


I Hon't integrate Bfiticg 


1 { U) 


0 


1(21) 


i son't staj focussed 


3 ( «) 


2 { 51) 


1(2*) 


Seed for folloi-ap 


r( 5») 


4 m) 


0 


Ho response 


20 


It 


4 



Process Writing 



I ae confident that I viK \ 

Dse recording as part cf science iV (15%) IG [HW ) (i; 

Integrate writing and science 37 (lk\] 18 (23%) IS (I 

Develop good writing prsjects 5 { 5*), 2 { 3^) 3 ( ' 

be fore writing 26 (2«) 24" (3^i) 2 ( 

Invoke students 3 ( 3t) C 3 ( ' 

Students will succeed and learn 14 (131) 6 (131) 8 ( 

Increase parent coosunication 1^1%) ' 0 1 ( : 

Dse writing to evaluate tiore 5 ( 5t) «^ ( 31} 3 ( ' 
effectively 

Share with others 2 ( 31) C 

Ko response 5 4 2 
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~ Talile Sir. (conl.r ■ 

Total lear One letr fto 

I have c.occeras about ^ - x ^ -^ 

Hi lack of experience 25 IS-fSSt) 7 ( 26) 

A Bilingual issues 4 Mlj i { «) . 2;M4) 

fiaev mageaent 21 (liX) 13 {nS] ^ ? f3fl») 

, to evaluate. vrititg 1 ( l^] 0 1 ( 41) 

\ Trjing to do too-auch _ 4 { l\) ' 2 ( iX)^ 2 { 7*) 

Onaotivatfed students 1 { W) _ I ( 2^1 0 * 

Student akilitj $ { i\) 2 { 4*)^ . 4 { 15) 

Students Wt risk 4 '{ l\) 1 { 2») 3 {111) 

Lack of sjstea support 5(11) 5(101) 0 

The need' for follow-up support 3 { W) 3 ( 61) 0 

Ko response _ 22 13 9 

I learned about inquiry science 

Science as inquiry 10 (171)^ 

Bov to use inquiry science 13 (221) 

Bands os is fun and important 13 (223J 

Boh to develop^taterial, 2 { 3l) 
n^e rjsources 

That I need to do core ; 2 ( 31) 

Bow to integrate inquiry into _ 8 (131) 
other subjects 

! have increased confidence , 5 ( i\) 

That inquiry science ircreases 7 {US) 

Dotivation m seif -confidence 

5e response 0 

I learned about process niticg 

tfritin^ helps studenzs understand 17 (391) 

Hov CO intgrate vriting vith science 7 (161) 

Science can notivate str^ents to write 3'( 1\) 

Stuaentr- can record effectively 2 { 51) 

Hqh to usi* the writing process 5 (141) 

Drawing is important for younger children J (141) 

Rriting iieips evaluate inquiry science ^ 3 ( 31) 

So response 1 
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with over 50%, Strongly Agree and over 84% Agree or Strongly 
Agree for each question is clear evidence of the positive 
perceptions of the teachers* When the evaluator examined the 
individual questions, he found that the only, exception to 
this positive prpfile occurred with the questions about the 
experience teaching ^in the Mass^ Migrant Education Program* 
The somewhat problettfatic responses to this*^ Specific segment 
of the^ summer r rogram are consistent with other data sources 
such as the intervievTs , conducted in the fall and spring* 

Short answer responses of teacher confidence and 
concerns about integrating inouirv scie nce and -process 
writing into their classrooms* The goals of the NSF PIES 
project were to get te^ichers to implement inquiry science and 
process writing in thc»ir classrooms* Table Six presentis the 
data which reflects teachers' confidence and concerns in 
fulfilling the goals* 

Discussjon * Data indicate 'that the NSF PIES Project was 
successful in increasing teach rs* confidence in implementing 
inquiry science in their classrooms and, to a lesser extisnt, 
in having confidence to use the increased resourcc^j at their 
disposjal* It is important to note that 20 of the Ft^lloWs 
made no response to having any concerns- about implementing 
inquiry science.. Indeed i this confidence expressed at the 
end of the summer workshop is reflected in the LoU data and 
\the observation data that was collected during the year* 
Expressed concerns about time, management, and materials are 
to be expepted* These are issues a.?e always present in the 
curriculum and instruction that characterizes handsron. 
inquiry learning;* As the evaluator has said elsewhere, 
without i^he cdtinued support of building and district 
administration and the opportunity to network with 
colleagues, teachers will find it increasingly difficult to 
maintain the process in their classrooms over a prolonged 
period of ti:re* 

While the data for the writing process is equally as 
positive in this suihmer questionnaire, the other data 
collected during the year do not show as much implementation 
as the inquiry science* The evaluator iu not surprised by 
the difference* First, the project simply did not devote as 
much time to the writing as it did to science. In fact, the 
second year program added the science emphasis of how to move 
from "hands-^on'^ to "minds--on" scienca and the opportunity to 
participate in more sci*ence input strands so that theiVi vas 
even iers emphasis on writing* Second, In the face of 
informavion and experience overload, teachers naturally 
worked on integ'^ating the more powerful of the new " 
experiences and knowledge bases* 

Short answer responses of teacher perceptions of 
presentations and worksho p strands > The strands represented 
the major science prv*isent.ations * In the first year, teachers 
could only sign up for one strand. As a result of their 
concern about missing too much science, the s^taff reorganized 
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Table 'SiTta. 

lear One and !bo Teacher Perceptions of Stmer Prograa 



Total 



Tear One 



Tear Tio 



L liltmit of tateria; eoftred - Strands 

£ajojable for student 3E (l5\ 

Pits disWct curriculuc ' 35 (lU 

Cac ose ih activities presested 62 (2St 

Kes ideas to use 50 (20) 

laportaat. citcepts for stuilsuts 28 (lU 

Ccodlor tf'iC.hing inquiry skills 9 -( U 

Cas ictesrate \iith other subjects 5 ( 2V 

Studer/iS leirc responsibilitj for 3 { l\ 

Yitit own learning 

ifivUdabl'c saterials 3 ( IV 

Chance to practice 3 ( U 

CoUegiai interaction 4 ( 2V 

Incrtased tj confidence to teach 7 ( 3V 

So response li 



(5t) 

( n) 

(301) 

m 

(3») 
(H) 



{ «). 
(51) 
( 8i) 



2? (m) 
28 (m) 

3'9 (23») 
28-(m) 
27 (16%) 
7 ( «) 
4 { 2*) 
3(2)) 

3 { i\) 

e 

i ( ») 

9 



Risb 1 had learned - Strands 



More practical activities 


24 m) 


7 (154) 


17 .m . 


More^theorj, science 


56 (5U) 


22 (m) 


34 ' 


More grade level activities 


10 ( 9t) 


i (,2») 


9.:(.u») . 


Kore ideas, tmits of peers 


2 ( 2)) 


2(«) 


0 ™ ■ 


Hore.about bilingual education 


3 ( 3t) 


0 — 


3 ( l\) 


HicageBent techniques 


2 ( 2t) 


2 ( «) 
13 (281) 


C 


Seeded sore tine 


13 (m) 


0 — 


So rMponse 


53 


16 


77 



Learned froa the strands 

Activities to use' 

Science theorj 

IsquirT skills 

Sharing ide:s vith teachers 

Hob tp adapt units for cf class 

So response 



71 (36») 

63 (32t) 

23 (U\) 

20 (lot) 

21 (lU) 

7 N 



:RIC 
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Table Seven, (cont.) 



Total Year One tear Tfo 



Strengths of Strands 



Si^afico i diss 




5 t ^ 


InQMindenl stuflT -^DnflrfcnsUies "^-^ ^ 






Xateriais^ gainedi 




17 ( 7 


leaching sngoestions 




7( (31 


Places to get-resources 




3 { 1 


Itprote tj in;uir7*skills 




18 { 7 


Learned science 




2<:{10 


Fun, BOlitating 




25{il 


Staff 




51 {22 


Itportant issiies for students 




${2 


Increased aj confidence 


' [ 


1 ( 1 


Can integrate into other areas 




4 { 2i 


Ho response 




5 



Sesknesses of Strands 



Critters lie 




leed lore theori 


2{2t) 


¥:ce, Binagefitct 


31 (36t) 


Kore jnde levei activities 


Ui\) 


Gettioq the uterial 


5(7*) 


Mj abilitT 


16 (19t) 


Hob to integrate with currieulun 


7 { i\) 


More tiae 


14 (16t) 


Bo response 


48 



Er|c 48 
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the second summer so that teachers could sign up for three 
different strands. "One-shot" workshop presentations were 
scheduled on a variety of topics throughout the three .weeks • 
Table Seven presents summary data on. these input sessions. 

Discussion* It jls ^clear; f rom the data that the teachers 
felt the input session* were important. Major areas of 
response show that the presentations provided teachers with 
material they could use, are important and motivating for 
students, and fit the district curriculum. The fact that 
most teachers did not complete the item "Wish I had learned" 
is also a clear indication that the presentations met their 
needs. It is interesting to note that many more Year Two 
Fellows responded that the concepts were important ones for 
students to learn. The evaluator feels that the difference- 
is due to the increased direct emphasis "minds- 
on", science received in the second year summer workshop. 
Another change in the secor'' year program is also reflected 
in this table. No Second Year Fellows felt they needed more 
time as contrasted to 13 First Year Fellows • The evaluator 
feels that the difference reflects the increased opportunity 
the Year Two Fellows had in participating in different 
strands . 

Finally, the heaviest areas of concern reflect the 
differences among the Fellows' prior experience with science 
and teaching responsibilities. Some people wanted more 
practical activities, others wanted more theory and 
background. A few teachers of younger students wanted' more 
grade level activities . These responses reflect the 
different experiences and needs that are inevitable in a 
large group (about 85) of elementary teachers* The evaluator 
feels; that the project. 'did an excellent job of meeting these 
needs. He also feels that the diversity of teachers added to 
the richness of the experience for them and was an implicit 
model for the' kind of diversity educators should be 
encouraging in their own classrooms. 

Short answer responses of teacher perceptions of their 
work in the Mass Migrant Education Program. Fellows for both 
years had the opportunity to work with classes of students in 
the Mass Mass Migrant Education Program. In afternoon 
classes, Fellows used the materials and methods they were 
learning about in the morning strands. Table Eight presents 
the data for this part of the program. 

Discussion . The major perceived strength of the Granby 
(place which housed the Mass Migrant Education Program) 
experience seemed to be the opportunity to practice. 
However, this experience was perhaps the most problematic of 
both summers. First, the logistics of getting to Granby on 
time and ready to teach given the full morning program were 
difficult. Second, some experienced Fellows felt the need to 
^et more information and materials and did not believe the 
practice would help them. Finally, the coordination between 
the Mass Migrant Education Program teaching staff and the 
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Tabfe Eight. 

tear 0:e and Trj !eacher Perceptions of Sosser Prografi atsGranbf 







X66I vUC 


Yftar 'Tun 














; ( St) 


V 


Pits district ^crricnln** 


3 ( U) 


0 — 




Can use the activities presented 


3 |i 41) , 


0 — 


3 {12») 


Hev ideas to use 


3 ( ^\) 


1 ( 2») 


2 ( 8») 


Affordable caterials 


1 ( l\) 


0 — 


i {- 4%) 


Chance to practice 


50 (74\) 


36 m) 


I4(S4») 


Collegia! interaction 


4 ( i\) 


1 ( 5») _ 


2 m 


Increased &i confidence to teach 


2(3»} 


1(21) 


1(4») 


So response 


18 


12 


6 



Rish I had learned * Granbf 
Xore practical activities 
Kore taeori, science 
Kore- ideas, units of peers 
Kore about biiingual education 
Xanage&ent techniques 
Keeded more tise 
General negative 
Ko response 

Learned f!:0G the Granbi prograc 
ictivities to use in class 
Inquiry skills 
Sharing ideas vith peers 
Eoi to adapt units for class 
Probieos of inquiry science 
Connunication skills 
More abon' bilingual issues 
lo response 

Strengths oj the ffranby rrogran 

Chance to practice 

Students enthusiastic 
^ Rori t^ith PISS teas 

Chance to vork vith differert students 

Managecent issues 

Heaknesses of the Prograc 
Hofking^ vith Granbj staff 
Logistics 

Unclear expectations 

Est enough tice for lessons 

Disinterested students 

Ko: reimnt 

Language issues 

So response 



2 ( 3») 


1 ( 2») 


1 m) 


8 (141) 


7 (151) 


1 (10*) 


i m) 


3(6») 


3 m) 


13 (221) 


3 (m) 


4 m) 


9 m 


3 (17») 


i m) 


2(3») 


2 ( 4\) 


c — 


18 (31\) 


18 (38\) 


0'-" 


36 


13 


23 



2 ( i\y 

3 ( 9») 
1 ( 31) 
9 (27\) 
3 ( 9*) 

7 (2U) 

8 (241) 
5 



23 (681) 
3 ( 9») 
(151) 

3 ( 9») 

4 (i2») 



5 



IS (33\i 

10 i'OI) 
9 (131) 

6 m) 

1 m) 

2 ( 4\) 

: ! l\] 



:RJC 



50 



Fellows was _not good. Some of the Fellows >^ere not welcomed 
into the classrooms. The 6%^aluator is not surprised at the 
problematic coordination. The Mass^ Migrtant Education Program 
teachers are interrupted by others who cojne into thjeir 
classrooms to offer a lot of "fun" activities with the 
students withoux any of the responsib^ility for ach^ "'^ment* 
The Fellows are juggling a complex schedule arid have no 
chance tjo set up classroom expectations or procedures. While 
NSF PIES staff did attempt to address the issue in Yea^r Two 
by designing an ef-fective introduction to the Mass Mifclrant 
Education Program for incoming Fellows and the Mass Migi'ant 
Educa:t.ion Program did a better job of getting its teachers 
ready for the scheduled interruptions to thei"r programs, 
there was no chance for the two sets j:^f teachers to wof'k 
together. 

The evaluator finds himself on the horns of a dilemma. 
While issues of diversity and equity ne to be addressed, 
the work with the Mass Migrant Education Program may have had 
the wrong effect, on Fellows because not enough time could be 
^pent in helping Fellows make important, personal meanihgs 
from the experience. 

Short answ er responses of teacher perceptions of the 
T eacher R rsource Center* During the summer program, staff 
from the Hitchcocjc Center ran a resource center for the 
teachers. This center was moved b^ick into the Hitchcock 
Center during the school year. As part of the NSF PIES 
Programr Fellows were given memberships in the Center as. one . 
way of encouraging ^hem to use the resources in their 
classrooms. Table Nine presents data about teacher 
perceptions of the summer center. 

Discussion. There is not much doubt that the teachers 
found the Hitchcock Center and staff to be very helpful. In 
fact, 60 Fellows had no concerns about the Center and the 
most mentioned concern was the heed for more time to spend 
looking through the materials. 

Short answer respon ges of teacher perceptions of their 
work in peer planning groups. Teachers worked in small 
groups to process the work they did in strands and to get 
ready to teach in the Hass Migrant Education Program. Table 
Ten presents data for their perceptions of that sharing time. 

Discussion. It is interesting to note that 16 teachers 
in Year Qne expressed some negative feelings about the 
planning tim^. There were some strong issues which surfaced 
around the differences between urban and suburban teachers. 
These differences led to problematic relationships. In 
addition, Year One teachers felt a need to learn more about 
the activities in other strands because they were limited to 
one. Finally, one of the components of the Year One Summer 
Program was a piece on Peer Observation. As with the 
writing, the added conceptual and personal demands were too 
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- !ible linti 

iiKz Ose Esd !v9 Readier Perceptions of Ssaer Seso&rce Center 

Total lear One lear !«o 

Seleyance o! tie Xesotirse Center 

Enjojable for stadent 2 1 2^) . ^ 1 ( ») . -1(3?) 

Cu use tie activities presented 3£ (3l\) . IS (2Qt] ' '2G (531) 

let ideas to ose 4S (381) 36 [kiX] 9 (2U) 

iffordable caterials 5 ( U) 1(11) 4 (m) 

Increased bj confidence to teach 2 ( 21) 2 ( i\] 0 

Eeiped zt to plan for lear i 2 ( l\] 4 (111) 

Staff lb ( i\) 10 (13y 0 

Oeceril positite "11 ( 91) 11 (141) 0 — 

lo response (24 

Rish I had learned * Eesonrce Center 

More practical actirities S (231) 3 (191) 3 (301) 

Kore ideas, units of peers i ( 41) C — i (101) 

Hore about bilingual education 1 { l\] 1 ( 61) 1 (101) 

Xanajeeest techniques 1 ( 41) 1 ( 61) G — 

Heeded' core tite 13 (501) 8 (501) 5 (501) 

Other 3 (121) 3 (191) 0 — 

So response 60 35 25 

learned through the Resource Center 

Materials to use . 28 (721) 

Hot tO'locate resources^ 11 (28^ 

lo response 3 

Strengths of the Hesource Center 

Learned about resources 33 (631) 

Staff 17 [m) 

Isprofe Di classroQc, cssfidesce 2 ( 4t) 

So response 2 

Weaknesses of the Resource Center 

Gas I flaistain sotivation to use it (121} 

Can I find tine to use it i (53») 

Logistics . 5 (29») 

Can tsej naintain the staff for us 1 ( 6t] 

So response 19 
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ilUt !es. 

Tear Ose »« letehe: !ereeptiofis of Smer !l^imin; fite 









Iwr tiQ 










^its difihrich cnrrienlnc 




0 — 


1 ( 3t) 






0 — 


4 (lUi 


lev ideis to m 


ii (in) 




9 (2U) 


Good foi(«.tetc!ii!:g inqsirj stills 


K n) 


0 -•- 


1{3») 


Chinie'V^l^ractice 


3( 3\) 


0 — 


3(8i) 


Collegial interaction 


50 (M) 


33 m) 


17 (4n} 


Increased fij confidence teach 


2( 2\) 


1{U) 


1(S») 


Helped te to plan for year 


20 (18\) 


IS 


1 ( 3») 


tleneral posijife 


16 (m) 


16 {21\) 


0 ... 


lo tespfase 


10 


6 


i 



8ish I had iearsed - ?lan:i:g Tiae 
More practical activities 
Kore theorji science 
More ideas, units of peers 
Kore about bilisgcal education 
Son to integrate into other subjects 
Hanage&ent techniques 
leeded core tise 
General negative, not relevant 
lo response 

learned f roc Planning Tite 
Activities to use 
Shared ideas vith tesehers 
Edv to adapt units for rj class 
Cotascicatis: skills 
Ko response 

Strengths of Planning lits 
Shared ideas 

learned hov to vork vith peers 
FuUf support 

Chance to practice inqu;:r skills 
So response 

Re^^'^.ases of Planning Tice 
Groups to6 large 
lot enough tice 
Group effectiveness 
So response 



2 { 5») 


5 ... 


2 (22$) 


< (m) 


< m 


0 ... 




6 (m) 


1 (115) 


1 ( 2\) 


0 ... 


1 m 


1(24) 


0 ... 


1 (m) 


2(5\) 


i(3\) 


1 m 


3 (20\) 


5 (161) 


3 (33») 


16 (39\) 


16 (50\) 


0 


57 


30 


27 



1 ( 2») 
20 (38\) 
17 (33\) 

n m) 



20 (59\) 

6 (m) 

7 (2H) 

1{3\) 
5 



2 (13i) 
5 (33\) 
8 (53\) 

17 



, ^ ^ ^ ^ ^ 

much for the Fallows to incorporate. The c valuator feels 
that these concerns are behind the negative feelings* 

By and large ^ however, Fellows f f^m both years :felt 
strongly that a major strength of the program was the 
opportunity it gave them for co^egial an^eractioii;, firoqn4 
professional . issues, this feeling was expressed in the* 
Summer Questionnaire, the interviews during the y^j^Vf the 
/ attendance at the school year follow-ups, and the ongoing 

activities that continue even after the-formal project ho? 
ended. 

/ 

Short answer responses of First Year Fellow perception s 
of the relevance of strands and workshops and the wigh for 
additional information. The data in Table Eleven represe;it 
questions that were asked in Year One and not Year Two. 
Tables Six through TeTi include analogous questions that were 
askf^d in Year Two and not Year One,. 

Discussion* The information again shows that the 

project has fulfilled its major goals of providing Fellows 

with ideas, materials, and confidence to implement an inquiry 
science curriculum in their classrooms. 
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Table Eleven. 
!ear One TcachSr ^Perceptiocs of PresentatioDS 
ReleiraDce and.Risb for idditional Isionsation 

Relevance of presentations 
Jnjo;able for stadents ' 1 ( II) 

Pits sy curriculim . * 4 ( 31) 

Can usje activities 13 (101) 

lev ideas to use 4$ (371) 

Important concepts tor students 14 (ill) 

Cood for inquiry skilk , 5 ( 41) 

Can integrate in other subjects 4 ( 31) 

CHasce to practice « , i { II) 

. Coiiegial interaction^ shared ideas 5 ( 41) 

Increased sj coiifidence 14 (HI) 

^ ioproved ny teaching S { 71) 

V General positive 13 (101) ' 

Ko response 3S 

Hish I had learned froQ pres^atlccs 

Practical activities 6 ( 51) 

Kore theory, science 13 (111) 

Grade ievel activities S { 81) 

Peers ideas, units 3 ( 31) 

^ More about bilingual issues 2 ( 21) 

^anagenent issues 5 I 41) 

K?re relevant to ay situation 27 (231) 

Keed aore tine 52 (441) 

^ General negative 2 ( 21) 

'Xo response 41 

C 



Parent Questionnaire 



Process 

The Parent Questionnaire was designed to assess how 
parents perceive their children's a.ttitude toward science. 
It was hot meant to provide any definitive data on the impact 
of the NSF PIES program but rather serve as part of the 
context in which to see the program. Questionnaires were 
mailed to the NSF PIES Fellows. In turn, they distributed 
the questionnaires and stamped, addressed envelopes to, a 
representative sample of children in their rooms. The first 
year, 5 questionnaires were sent to 40 NSF PIES Fellows. Of 
these, 51, or 25.4%, were returned. The second year, 8 ^ 
questionnaires were sent to 35 NSF PIES Fellows. Of these, 
78, or 27.9%, were retul:ned. 



In keeping with my informal contract wiuh the teachers 
as part of the evaluation, I did not choose to identify the 
teachers in any way. I had no way of determining which 
teachers chose to distribute the questionnaires or 
encouraging them to get involved if they hadn't. Thus, the 
data exist across a wide range of variables with no real way 
for us to determine^ how to weight them in interpreting the 
parent responses. 



Data 



Nonetheless, the parents who responded were very 
positive towards their children's experience in science for 
the year. Table Twelve presents the results. 

Table Thirteen presents the aggregated total of parent 
comments for both years as there was no real difference 
between the two years. As expected, there. were more comments 
(30) in Year Two than in Year One (22). 



Table Thirteen. 
Optional Parent Comments 



General favorable comments 11 

Reaction of child has been positive 22 

Child's interest has grown 7 

Talked about experiments 8 

Brought science home 5 

Favorite subject 3 

Good teacher " 3 



Science is important 13 
Have more hands on science 8 
Hands on science good for students 4 
Good science background important 1 

Did more science in scouts 1 
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Table !vel?e. 
?ar$nt Questionnaire Responses bj lear and Total 



1. Mr child has talked- about the science vork he/she has done in school this |ear. 

stj:onglj strongly co 

agree agree disagree ^ disagree opinion 

m Ml) 2i (41.21) 28 {54. n) 1 (2.01) i (2.01) 0 

Ir2 {n=78) 36 (46.2*) ^9 (50%) 0 1 (1.3*) 2 (2.6*) 

2. Ml child has brought his/her science work hoce do and'shorus this jear. 

Irl Ml) 15 (29.4*) 31 (60.8*) 1 {2,0i) 2 (4.0*) 2. [iM] 

Yr2 {d=77) 28 (36.4*) 38 (49.4*) 7 {9.1*) 2 (2.61) 3 (3.94) 



3. My ckiid has bee^ interested in science topics and activities this year bejond 
the vork he/she does in school. 

Yrl Ml) 22 (43.11) 23 (45. ») 4 (8.0*) 1 (2.0V) 1 (2.0V) 

Yr2 (n=78) 32 (41.0V) 34 (43.6V) 6 (7.7V) 2 {2.6V) 4 (5.2V) 



4. Xj child^s interest and involveeent in science has*^ increased this year. 

Yrl (n=51} 2C (39.2V) 23 (45.1V) 6 (12.flV) 1 (2.0V). 1 {2.0V) 

Yr2 (n=78) 35 (45.0V} 35 (45.0V) 3 ( 3.8V) 2 (2.6V) 3 {2.?V) 
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Did. not notice i^ncreased interest in 
science 

Did not do any hands on science 
Had a po6r teacher 



1 
1 
1 



Discussion 



The parent dat,.* are all positive • The percentage of 

positive responses ranges from 84% to 96%. In addition, the 

opitionr^l written comments show that parents feel very 

positively toward the program both in their favorable 

comments and their feelings that science is an .mportant 
subject. 



As I said in the beginning of the presentation of this 
data source, the information from this data source cannot be 
used to present proof of the impact of the NSF PIES program* 
Nonetheless, it does add to the positive context in which we 
see the program. 



58 
ERIC 

NSF PIES Final . Report 



27 



Follow-up Questionnaires tor Year One Fellows 

Process . 

Based upon ztie LoU interview \data, the evaluator 
designed a short questionnaire which he mailed to the Year 
One Fellows in May, 1989, one full year after they had 
completed their formal project work. Thirty-ono of the 
Felloe's returned the questionnaire which is about a 75X rate 
of return. The questionnaire offers a series of responses 
for each question. These responses are based upon the 
Fellows' responses to similar questions asked during the L6U 
interviews. Fellows checked as many of the options as they 
felt applied and had the opportunity to write in other 
answers they felt werd relevant o While this questionnaire 
does npt provide the mcS:e telling inforniation contained in 
either classroom observations or a prolonged interview, the 
evaluator feels that tl^e data does reflect tht, positive 
impact of the NSF PIES program. 

) Data and Discussion 

Table Fourteen presents the data. It is not surprising. 
First, Year One Fellows see that ±he , strengths of hands--on, 
inquiry science in terms of its impact ori students far 
ouf'.weigh its weaknesses of time, managenent, '^and materials. 
The evaluator has> said elsewhere in this report that the 
strengths and weaknesses are inherent in i:he inquiry approach 
and that the weaknesses can be dealt with succe? •fully by 
supportive building and district administration. 

It is also interesting to note here the first positive 
data about how Fexlows are integrating writing into science 
since the questionnaire they completed in July, 1987. Then, 
the Fellows Expressed . cpnf idence in thei-r being able to 
integrate writing, with, science. However, in subsequent 
inteviews, the Fellows did not mention having success with 
the writing process. Here, however, 16 of the 31 Fellows who 
returned the questionnaire mention that the NSF PIES Project 
was instrumental in their ^^integrating writing into their 
science curriculum. It is possible that once the Fellows 
felt confident about their abilities to integrate inquiry 
into their classrooms they were able to turn their attention 
to another Innovation. The evaluator is also aware of the 
growing focus on process writing by school districts in the 
area and the accompanying, staff development opportunties in 
process writing. Some combination of the two factors for the 
teachers is the probable reason for the change. 

Second, the strengths of the NSF PIES Project lie in Its 
staff, the collegial and growth opportunities it offers 
teachers, and ideas and resources it provides them for their 
classrooms . 



Finally, the Fellows feel stror).gly that the NSF PIES 
program has had impact upon them as professionals- Not only 
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Tib1e Fourtten. 
' - Follon^up Questtonnaire for Yeir One Fellows 

Ihit ire^thd strengths of hinds-OHi 

intjuirV ^science? ^ ' - 

HotivtteSi interests students 31 

Activity oriented 27 

Students leirn cooperition 27 

Students leirn, reaeaber better 27 ' 

Non*yerbtll students succeed ' 2S 

Students leirn probles-iolving, inquiry 23 

Students leirn responsibility for ovn 13 
leirninj 

There is i cirry-w/er to other subjects IT 

Student centered ; 1 * ' 

Hone 0 

lhat are the weaknesses of hands-on, 
inqui/y science 

Tine fof preparation 21 

Maintaining -supplies IT 

Space in room U 

Finding tine for if 

Nanasei&enti noise 10 
Adninistritive si'pport 

Student background , , 2 

Student learning style 1 

Energy level req^iired 1 

Kone 1 

lhat imct has PIES had on ay teaching? 

Grown^as 'rprofessiona! ^. 24 . 

Tane core risks , ^1 

.Use the inquiry process in siy 20 

science teaching 

Have becoiae sore focussed on students IB 

Hore comfortable vith science IT 

Integrating writing with other 16 

subjects , ' ' 

Use the inquiry process in other 14 

subjects 

No response 2 

Khat are PIES prograc strengths? 

Staff 25. 

Hateriais, rtsoufces to use IT 

Coilegiai e)(perjence IS. 

I aai Rore confqrtibie with science 13 

The Hitchcock Center and staff 12 
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The suiaer progrisi 
Students Seirn ind res^esber better 
Prcsna's orjinuition ind losistfcs . 
The.chince to pnctice during the 

roliowup activities ^ ^ ^ ^ 

Diverse^ rich progriQ an^ people 

lhat are PIES pro9raQ v.^kResses? 

Ve need .core science, 'theory '.ind. practice 
Interface with the sigrant prograti 
Hone ' 

Kore foHov-up activities 
SoBQ susffier presentations 
Prugran's organizcMon, logistics 
No response 
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do many of the respolidents talk about the changes in thjeir 
classrooms, but the evaluator is aware of other important 
data which indicates that the "professioriial growth" and 
^'willingness to risk" teachers mention go far beyond the 
classroom. About ten of the Fellows i have enrolled for 
graduate work. Two of thfe Fellows have become resource 
teachers in science for their districts.^ Anothtir teacher 
received one of ten Lucretia Crocker Fellows^hip awards in ^ 
Massachusetts for the 1989-1990 school year. Her fellowship 
was in elementary science and enabled her to work with 
teachers in many Massachusetts school districts during the 
past year. A number of teachers received state grants 
awarded through their own districts to develop elementary 
science curriculum and work with their peers in disseminating 
the information. Three are currently working as staff at 
SPACEMET, another NSF science program funded through the Five 
College Public School Partnership. 
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Observation 
Process ^ 



The evaluator worked with two (one in each year) 
assistants, both of whom were very familiar with the idea of 
hands-on, inquiry science • The observation criteria were 
established the first year and appear in Appendix Two, The 
evaluator scheduled times for the observations with the NSF 
PIES Fellows because of his previous contact with them* All 
the observations were conducted in the spring of the year 
with the assumption that the teachers would have had time 
enough to feel some level of uomfort with the inquiry process 
and new curriculum, testing, field trips, and other end of 
the year activities as well as observer schedules made 
getting to all the Fellows* classes problematic. However, 
the observer for Year One Fellows visited 26 teachers and the 
observer for Year two visited 24* classes. The evaluator 
considers both the number and range of classrooms to be 
representative of the Fellows. The observer for Year One did 
not include a summary of the classes so the evaluator 
specifically requested this sor-t of summary from the observer 
for Ye^r Two, 

Data V ^ 



Given the criteria established in Appendix Two, the 
observers noted the following: 

Minimal Hands-on Hands-on 

No Minds-on Minimal Minds-on MindS-on 

Year One Fellows 3 10 13 

Year Two i-ellows 3 6 15 



Discussion 

"First and foremost, there seemed to be quite a bit of 
confusion about the meaning of hands-on science and inquiry 
science and how thes^ related tp the major goals of the NSF 
PIES program, . I asked a few teachers what they believed I 
was there to see and they replied hands-on science, I 
suggest to avoid this confusion that more time be spent on 
defining and distinguishing between these two terms. As I 
see it, the hands-on method is in most instances (except in 
rational inquiry) an essential prerequisite of inquixv 
science," 

« (Year One Summary.) 

"Of the twenty four classrooms I oDserved, fifteen 
showed clear evidence that the ideas, philosophy and skills 
learned by the teachers through NSF PIES had become an 
important and integral part of their science teaching. These 
were classes in which students not only were learning to "do" 
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science, but to question, reflect on and verbalize about it. 
In these classes, teachers, as a rule, asked open-ended 
questions, encouraged divergent thinking and shared their 
students' enthusiasm for discovery. They created a structure 
for inquiry and a student-centered learning environment that 
let students know their ideas and conclusions were 
interesting and valid* 

"These were also the classes in which science was 
typically integrated with math and writing ,j and in which 
there was usually a good discussion before and after the 
activity. Students in these classes were more verbal and 
better able to make sense of what they were doing and 
observing and how it fit into a bigger picture* 

"There were six classes I observed that showed. signs of 
minds-on but were predominately hands-on. In these classes, 
teachers asked some open-ended questions while circul5*.ting in 
the room, but during group discussions not much supposing and 
hypothesizing was elicited from students. These teachers 
relied mostly on the GEMS or ESS specified procedures to 
carry them through. 

"Two classes exhibited hands-on science activities in a 
comfortable erivironment , but there was evidence of student 
independent thinking or problem solving. One class had no 
evidence of either hands-on or minds-on activity on the part 
of students. 

"In nearly all of the classes I observfjd, the students 
were enthusiastic about the activities, seemed used to doing 
hands-on, and were eager to share their observations. In the 
more mihds-on classes, they were able to discuss hypotheses 
and often went beyond the prescribed activity to test a new 
theory. 

"Three fourths of the classrooms had lots of science and 
problem solving "stuff" around the room — on shelves, tabl^ 
tops and in learning centers. Only two were totally devoid 
of stuff and the rest had at least one center Set up, usually 
related to the current unit." 



(Year Two Summary) 



Classroom observations indicate that NSF PIES Fellows 
were using hands-on science in their classrooms and that many 
were involving the students in the inquiry process. It is 
interesting to note that a higher percentage of Fellows were 
using the inquiry approach in Year Two and that there was 
some confusion on the part of Year One Fellows as to the 
difference between the two. NSF PIES staff directly taught 
the difference between hands-on and minds-on science in the * 
Year Two summer program; and, the evaluator believes that the 
difference is directly related to the change • 
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QUESTIONNAIRES AND INTERVIEW PROTOCOLS 
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Questions For F^SES Interview 

K Rrc you currenily usin^ hdods on inquiry science? 
if NQ» 

2. HdV0 you mado a decision to us9 hands on 
inquiry science in the future? 

3. If so, when? 

4* Can you describe hands 'on inquiry science . 
for me as you see it? 

5. What do you see as its strengths and 
weaknesses in your situation? 

6. Rt this point in tirrte, uhat kinds of 
questions are you asking about it? 

?• Do you ever talk uith others and share 
information about it? Mhat sort of 
information do you share? 

8. Uhat are you planning uith respect to it? 
Can you tell me a* ^ut any preparation or 
plans ijou have been making for the use of 
hands on inquiry science? 

9* Can you summarize for me uhere you see 
yourself right nou in relation to the 
use of hands on inquiry science? 

10. Hoy uould you characterize your school 
district's support for science? 

11*. Has the PIES Project had any impact on 
you as a teacher? Please elaborate. 

12. Rs a uay of summarizinO) uhat do you 
you see as the major strengths ^k) 
weaknesses of the PIFS Project? 
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if YES * ^ 

2. Please describe for me how you use hands on 
inquiry science. 

3. i^at do you see as the strength « >r>d weaknesses 
of it? Have you m^do any attempt to do anything 
about the weaknesses? 

4. fire you cur^r^ntly^ looking for any information 
about hands on inc^ry susience? Mhat kind? For 
what purpose? 

5. Do you work with others in your use ^f it? 
Have you made any changes in your use of hands 
on inquiry science cn the basis of this 

col laborat ion? 

6. Do you ever ijlk with others about it? 
Hhat do you t^ll them? 

0 

7. Rre you dcting any evaluating, either formally 
or informally that mi^t aff<»ct your use of it? 
Hhat have you done with the information you have 
gotten? 

8. Have you made any changes Recently in the way 
you us^ it? Mhat have they been? ifluj have you 
made them? Bre you considering making any. changes? 

9. Rs you look ahead to later this year, what plans 
do you have in relation to hands on inquiry science 

10. How would you ch^iracterize your school district's 
support for science? 

11. Has the PIES Project had any impact on you as 
a teacher? Please elaborate. 



12% Rs a way of summarizing, wttat do you see as 
the majoi 
Project? 



the major sL engths and weaknesses of the ^^^^gg 



GOALS 



There are two major goals of this projectji integrai^ino 
inquiry-based s^cience into the classroom and. integrating 
writing into the teaching of science. Please comm&nt on how 
comfortable you now feeT~in these two areas? 

Goal. I: integrating inquiry science into my classrjdofn 

I feel confident that... I have concerns that... 



Goal II: integrating the writing process into the teaching 
of science 

I feel confident that... I have concerns that.. 
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PLANNING NEXT YEAR 



There were? of course? many different components to this 
summer's program. Please coniment upon each of these so that 
we can plan effectively for next year. 

1. Which STRAND did you attend? 1. 

Please comment on the content and structure i.e. the a<nount 
on time spent on one topics the meeting^ on this topic 
during the three weeks? of the STRANDS. 

relevant to my teaching I wish I could have >l,earnerd . . « 

because . • • 



£. Comment on the seven-afternoon program in Granby. 



relevant to my teaching 
because • • • 



I wish I could have lecxrned... 



3. Presentat ions on Inquiry/Process 



relevant to my teaching 
because. • • 



I wish I could liave learned-.. 
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4. Presentations on Peer Coaching 

relevant to my teaching I wish I could have learned, 

because. 



5. Presentations on Writing Process 

relevant to my teaching I wish I could have learned, 

because ... ^ 



6. Mini-workshops of specific topics (please list what you 
attended ) 

relevant to my^ teaching I wish I could have lectrv;ed* 

because . . . , 
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7. Single presentations to the whole group by guests and 
staff ' 

relevant to my teaching I wish I could have learned 

because* . . * 



8. Resource Center and visits to Hitchcock Center 



relevant to my teaching I wish I could have learned 

because . . • 



9, Planning time with other teachers 

relevant to my teaching J wish I could haVe learned 

because. . . 
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10. Physic. 1, time and support arrangements (space? food? 
resources? schedule of the davj'etc.) - 

helpful to me it would have been better if... 

because ... ^ 



11. In retrospect? how helpful were the two Saturdays? What 
chfinges should be made for next year in the dates? 
activities? topics covered? 
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IE- There are certainly aspects of the prograim which have 
not be covered by these questions. Please use the rest of 
this page (and additional pages if you would like) to 
provide any additional feedback to us about the program s'' 
far or about changes that you suggest for this ne>;t year and 
for the second cycle of Fellows. 

Thank you. 
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July 18, 1988 



Dear PIES Fellows, 

Here is the evaluation for the Stimxaer Program. Whil^ it is 
somewhat lengchly, it should not take you too long to 
complete. Because the PIES Project is a model of staff, 
development, it is important for us to get feedback from you 
about the each of the different components of the program; 
'and I have designed the evaluation with that purpose in mind. 

Here is a brifef guide to the questions. 

Bastion One asks for your comments about the two major 
goals oie the project: integrating inquiry science into 
your classroom; and; i integrating the writing process 
into the teaching of sciepce. 

Pl?ase briefly complete the. sentences in the space 
prcvidfifd for each question in this s" ;ti6n. 

section Tvo asks for your opinions about the different 
major components of the project. For each component, 

Please circle whether you Strongly Agree, Agree 
Disagree, or Strongly Discgree with the first 
statements , and 

in the space provided, briefly complete the 
sentences or phrases that follow. Please note that 
we ask you fcr your ideas about what you learned 
and what you wish you had learned and what will be 
relevant i:or your classrooin and what won't. 

Section Three asks for your opinions about the single 
presentations. For each presentation. 

Please \circle whether you Strong: qree. Agree 
Disagree, or Strongly Disagree witn che first 
statements, and 

in the space provided, briefly complete the 
sentences or phrases that follow. 

Becticn Four asks fbir your comments about the Spring 
program and the organization of the coming year. 

The small space for the brief responses is my at'tempt to ciit 
down on the time it will take you to complete the 
questipnnaire. If you do need more room for a question, 
please use the back of the page. Thanks for your timer I 
look forward to seeing you in the Fall. 

Sincerely, 
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1. intttgrating inquiry soiano^ ipto »y olassrpoa* 

I have learned that 



3> feel confident that 



I have concerns that 



2 • Integrating the writing process into the teaching of science 

I have learned that 



I feel confident that 



I have concerns that 



8SCTION CT0> MAJOR PROJECT COMPONBKTB 



1. WEEK #1 MORHZHG STRAMD (plfase list). 



The organization (laix of activities, SA A D * "SD 

pacing) of this strand was conducive 
tO' learning. 

I had enouyh time and encouragement SA A D SD 

to get my questions and concerns 
■ answered. 

^ . ^ <> . 
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The material I learned in this strand 
will hB relevant, to my clas'sroom. 

I had enough time to exchange ideas 
and experiences with my colleagues • 

In this straiid I learned 



SA 



SA 



SD 



SD 



wish I learned 



This strand is relevant 
to my teaching because 



is not relevant because 



The major strength of this strand are 



My concerns about this strand are 



2. VEEK #1 AFTERNOON STRAND (please list). 

\ * / * 
The organization (mix of activities, 
pacing) of this strand was conducive 
to learning. 

I had (Bnough time and encouragement 
to get my cpiestions and concerns 
answer;ed. 

The material I learned in this, strand 
will be relevant to iay classroom. 

I had enough time to excharge ideas 
and experiences with my colleagues. 

In this strand. I learned 



SA 



SA 



SA 



SA 



A 



D 

b 



SD 

SD 

SD 
SD 



wish I learned 



This strand is relevant 
to my teaching because 



is not relevant because 



The major strengths of this strand are 
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My concerns about this strand are 



3. WE8K «2 MORNIMO BTBXOD list). 



The organization (mix of activities, 
pacing) of this strand yas conducive* 
to learning. 

I had ^ enough time and encouragement 
to get my g[uestions and conc:ems 
answered.. ^ / \ 

The material I learned in this strand 
will be relevant to my classroom. 

I had enough time to exchange ideas 
and experiences with my colleagues. 

In this strand I lean^ed 



SA 



SA 



SA 



A/ 



SD 

SD 

SD 
SD 



wish I learned 



This strand is relevant 
to my teaching bececuse 



is not relevant because 



The major strengths of this strand are 



My concerns about this strand are 



4. WEEK #3 MORNING STIU^ND (pXeasa list). 

The organization (mix of activities^ 
pacing) of this strand was conducive 
to learning. . * 

I had enough time and encouragement, 
to get my questions and concexm^ 
answered. 

The material I learned in this strand 
will be relevant to my classroom 

I had enough tine to exchange ideas 
and experiences with iay colleagues. 



SA 
SA 

SA 

SA 



A 
A 



D 
D 



SD 

SD 

SD 
SD 
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In this strand I learned 



\rish I learned 




This strand i alevant 
to my teachint^ ecause 



is riot relevant because 



The major strengths of this strand are 



My concernfe eO^out this strand are 



5. The afternoon program at Granby/Holyoka 

The organiza:tion (mix of activities, SA 
pacing) of this progreoa was conducive 
to learning. 

I had enough time and encouragement SA 
to get my questions and concerns 
answered. * 

The material I learned in this program SA 
will be relevant to my classroom. 

I had enough time to exchange ideas SA 
and experiences with my colleagues. 



D 
D 



SD 

SD 
SD 



In this program I learned 



wish I learned 



This program is relevant 
to my teaching because 



is not relevant because 



The major strengths of this program are 



My concerns about this program are 
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€• JJm% of thm rsscuroft oMt^r 

The organization (mix of activities, 
pacing) of this opporttmity was 
conducive to learning. 

I had enough tine and encouragement 
to get my questions and concerns 
answered. 

The siaterial I learned in this 
opportfunity will be rel^eyant to 
my classroom. ' 

I had enough time to exchange ideas 
and experiences with my colleagues. 

From this opportunity I learned 



SA A d SD 

SA A b SDv 

SA A ,D SD 

SA A D SD 



wish I learned 



This opportunity is relevant 
to lay teaching because , 



is not relevant because 



The m ooir strengths of this opportunity is 



•I 

My concerns about this opportunity is 



7. Planning time with other teachers 

The, organizat^ion (mix of activities, 
pacing ]| of these, opportunities was 
conducive to learning; 

I had enough time and encouragement 
to get my question? and concerns 
answered. \ - 

The. material I learned in these 
opportunities will be relevant to 
my classrooip^. 

From these opportunities X learned 



SA A D SD 



SA A D SD 



SA A D SD 



wish I learned 
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These opportunties are relevant 
to my teaching because 



are not relevant because 



The major strengths of these cpportunties are 
My concerns about these opportunties are 
SSmSfi THRBB. 8INQLB PRBBgNTATIOlfS 

1* Working with Migrant Students/Mary 

The organization of this presentation SA A D SD 

was conducive to learning* 

The material I learned in this SA A D SD 

presentation will be relevant to 
my classroom. 

The major strengths of this presentation are 
My concerns about this presentation are 



2 c Maitagoment of materials/Staff 

The organization of these presentations SA A D SD 

was conducive to learning* 

The material I learned in these £5^ A D SD 

presentations will be relevant to 
my classroom* 

The major strengths of these presentations are 



My concerns about these presentations are 
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Z. Working vith lLdAiniatr4tor«/Chr«n 

The organization of this presentation SA 
was conducive to learning. 

The Material I leazmed in this SA 
presentation will be relevant to 
my classroom. 

The major strengths of this presentation are 



My concerns ad^out this presentation are 



4. Thoory of Inquiry Scienoe/Diolc K. 

The organization of this presentation SA 
was conducive to learning. 

^he material I learned in this SA 
presentation will b6 relevant to 
my classroom. 

The major strengths of this presentation are 



My concerns about this presentation are 



5. Teaching about Space Science/ Juanita, Mary Alice 

The organization of this presentation SA 
was conducive to learning. 

The material I learned in this. SA 
presentation will be relevant to 
my classroom. 

The major strengths of this presentation are 



My concerns about this presentation are 
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5. rinal v««)c pot pourris/Statf 

p 

The orgar^lzation of these presentations 
was conducive to learning. 

The material I learned in these 
presentations will be relevzmt to 
tsj classroom. 

The majos: strengtlts of these presentations are 



SA 
SA 



A 
A 



D 
D 



SD 
SD 



Hy concerns about these presentations are 



SECTION rQ?R ZIMMt SSt 



'A 



1. In retrospect, how helpful were the two Satur''\ys (what did you 
learn, how were they relevzmt to your teachi? how did they set 
helpful context for the sunnaer)? 



2. As you think ahead to the cooing school year, what concerns do you 
have about the PIES project? 



3. If you wish, please use the back of this page to jrovid<£ us ^ 1th 
other ideas or opinions that are importaLit to you. 
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June 1, 1989^-. 



Dear First Year PIES Fellows, 

As the PIES Project officially draws to a close, I would like to get a final 
view of th? project from you. Your reflections would be most helpful to 
md in evaluating the project because it isn't often that r get the chance to 
hear from people over a prolonged period of time. Would you please take a 
few moments to answer the questions on this page and return it to me in 
the enclosed stamped, addressed envelope? I realize that the end of the 
year is a busy time, and don't mind if I get tnese in egrly July. The 
numbers are to help me keep track of who has completed the form and who 
hasn't, not to idehtiify your answers. Thanks. 

Sincerely, / 



1 What do you see as the major strengths and weaknesses of hands on, inquiry science In your 
situation ? Please circle as many responses as you feel ajjpropriate. 




Strengths 



Weaknesses 



a. Motivatfesjnte.'^ests students 

b. Activity;orient£j 

c. Non verbal-students succeec: 

d. Students learn, rerrember better 

e. Students learn problem solving,^ 



a. Management, noise 
Time for preparation 

c. Findingti main schedule for 

d. Space in room 

e. Materials 

f. Administrative support 

g. student backgrounds 

h. Student styles that don't fit with che 



inquiry 

f. Process carries over i nto other 



subjects 

g. Students learn cooperation 

h. Students learn responsibility 



process 
1. None 
j. other 



for learning 
i. None 

j. Other'{ please list) 
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2. Have you madeany changes in teaching hands on jnquiry^sCience (organizing for 
instruction^ organising your classroom, teaching, evaluating students and'not just using 
different units)? PJease briefly list the most important ones for you, if you have. 



3. Has the PIES Project had any impact on you ^.s a teacher? Please circle all that apply. 

a. I am more fopussed on the learning process of students. 

b. \ am more comfortable with science. 

c. I am using the inquiry process in my teaching. 

d. I- am more enthusiastic, 

e. I amusing the inquiry processin other curriculum areas. 

f. I am integrating writing into other subject areas. 

g. I take more risks, don't need to feel I have to knew all the answers in class. 

h. 1 have grown professionally, doing different things, 
j. No impact. 

k. Other (please list) 



4. What are the major strengths and weaknesses of the PI£S Project. Please circ.e up to three 
mcst Important that apply. 

Strengths Weakneses 



a. Ccr.egial experience 

b. PIES staff 

c. Students learn, remember bettfer 

d. I have become more comfortable with science 
c. I got good materials, resources 

f. Hitchcock Center and staff 

g. Follow-up activities , 

h. the summer gave u^j the chance ^o learn the 

way we would be teaching th& students. 

i. Thexhance to practice with students in the 

summer. 

j , Organization, logistics, communication 
k. None 

1. Other (please list) 



a. Follow- up hot as extensive as it could 

have been. 

b. Organization, communication, logistics 

c. Interface with migrant program . 

d. Organization of summer strands 

e. Not enough chance to go i nto depth witb 

content areas 

f. Not enough chance to cover enough 

content areas 

g. None } 

h. Other (please list) 
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Dear Parents, 

1 am the evaluator.ot a -f^sderally funded program which is 
working oh science educataon -For elementary school children. 
WoLild you please help ^me by taking a -few moments to' answer 
the following questions and returning this' questionnaire to 
me in the stamp&d enveloped I have provided. Your opinions 
are important, and I hope vou v^Ji i i .^a'r-s the tima tp. complete 
this form and mad 1 it back to mc. Incu'iL ycu for your time. 

Si ncerely , 

r r ^ 

Thomas E. Wo] f , Evai uatbr 

PROGRAMS IN FLeME^]T^.RV SCIENCE " . ' 



1. Hy child has tc^i Ked about the science wom" ns/she has 
done in school this ycjar. 

strongly ^ s-ronqiy no 

agree agree disagree dissqree opinion 

2. My, child has brouoht hi b /her scibnc.^- hc?ne to ab anc 
show us this year. 

strongly strongly no 

agree agree disagree disacree opinion 



3. My child has been interested in sci^i«ce topics and 
activities this year beyond the work hs, she c^ob£ in school 

stron.jiy strongly no 

agree agr&e disagree disagj^ea opinion 



4. My child s interest and involvement in science has, 
increased this year. 



sLrongly no 
agree disagree disagree opinion 

If you nav^ anything yoy. would liie to ridd tnat we have/ not 
asked about with fchesu^ questions, piea^^e Write it ih the 
space below.. 



strongly 
agree 




APPENDIX TWO 
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PIES - Partners in Elementary Science Classroom Observation and Evaluation 

1 

Submitted by Julie Rypysc,' July 1, 1988 for Tom Wolf 

As the classrcxxn evaluator. for th^ PIES pjrogram, I realized my goals from 
two sources^' . ^ 

1. The PIES grant proposal 
'2. xom Wolf , the JEValiiation Coprdiriator 

Based on the goals of the program stated in the grant proposal > I was to 
evaluate the teachers^ ability to teach inquiry/process science^ ' A secondary 
goal was to note %f the.in^^egration of science and/ writing was occuring in the 
classroOTis under obse^-ation. 

Tom Wolf instructed me to provide feedback in three areas: 

1. Note to iwhat degru^ was* the lesson hands-on, inquiry 'oriented ♦ 

2. Note does the teacher exercise effective classroom management 
diir'^jig the. lesson. 

3. Note is thera^ time set aside at the- end of the lesson- when the teacher 
reflects on Qie lesson and reinforces or summarizes the major concepts 
or themes covered during the lesson, with the students. 



I believe it is iniportant to state a:i operational definition of inquiry/ 
process science that I based my observations and evaluations on. The fol 'lowing 
are statements taken frani 2 sources that he"*?' formulate ray definition. 
From: Teaching Science Ihrough Discovery by Carin Surd, Fourth Edition. 

A discovery (or inquiry) activity is a lesson you design so your students, 
through their own mental processes, discover concepts and 'principles for them- 
selves. 

Fran: Teaching Elementary Science - 4th Edition by William arid Mary' Esler 

Inquiry techniques hL-p children to develop process skills. 

Teachers are teaching by inquiry when 1. students are involved in problem 
solving, 2. students are developing manipulative axxd higher-level cognitive 
skills 

To recognize inquiry ask ydur self 2 questions : / ^ 

1. Are the children required to go beyond "'die given information to gain 
new insights? 

2. Are the children problem solving - looking for answers or generaliza- 
tions origional to them? ' 

, 4^cording to^the Eslers, ther^ are three types of inquiry learning activities 
l'. rational iapproach 
2 . .discovery^ approach 
3,. experimental approach. 

1. Rational appr&ach - The teacher indirectly guides a class. id.th open ended 
questions and cl .ef ul responses , from the presentation of a problem to a success- 
ful conclusion , that takes the form of a scientific concept. The final response 
must come. from the students thamselves not the teacher. *lhe teacher uses selec- 
tive ^reinforcement where the strenght of the reinforcement for eac^i student 



response serves to guide and direct the flow of the verbal interaction toward 
the desired principle or generalization*. Sometimes the teacher must supply 
additional information by saying ''What if I told you that v. 2" or 'TOiat about 

this--.r' 1 5 ^ 

Pure Discovery - , . . 

.2. Discovert' Approach - Ihe students are jgiven material and no gui,delines. Cunosity 
leads them to their own discoveries (pure messing about). The 'teacher- raovtes 
about as a guide or advisor. The teacher refrains from answering questions di- 
rectly rather he/she should help stiidents organize their thoughts and ^estiga- 
tions so as to answer their own questions, '^fow c<:a we tfist this? , ^kw can ^ 
we find out?" * ' 

Guided Discovery 

The teacher gives the whole class or group orga'^-izing question to guide, or 
direct their discovery. 

3, Experimental Approach - Children formulate and test hypotheses. This approach 
teaches children to define and control variables in experimental situations^ 
to experiment and to interpret datas as well as to hypothesize. 

ini,tion of Process Science - Inquiry techniques help children to develop process 
sliills. In process science students exercise mental activities .that are used to 
acquire knowledge. These'Jprocess^s in science" are also termed ii.quiry processes 
and are listed on the attached tiandout entitled - The Processes in Science - 
(observing, classifying, predicting etc.) 



Evidence of Inquiry Leamin;^ in the Classroom 

Since I was only able to observe each PIES pa>:ticipant for 1^ 45-60 minute 
.science lesmn, I identified pieces of evidence ^tha^t indicate inquiry/process 
science' is\ going on in the classroom by 4 means: 

1. Observing teachar teach lesson to children 
> a. Teacher behavior 

b. Student behavior 

c. activity itself 

2. Notiiig physical evidence in the classroom .r materials etc. 

3. By talking to the teacher 

4. By talking to the students 

I used these criteria for evaluating inquiry/process science because I 
believe that they indicate that inquiry/process science is toing .on: 

Teacher Behavior : <; . * ^ 

1. Does the teacher go with students interests? 

2. Does the teacher ask divergent/open ended questions? 

3. When students ask teacher question, does he/she encourage them to experiment 

or think to find out themselves, i.e. What do you think?, How can we find out? 
rather x.han giving them the answer? 
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(Teacher Behavior U^'ji't) ' 

4* While sti^ents are investigating, does the teacher circulate around the 

room in a facilitator irole checking in witii individuals or small groups? ' 
5o Where \does the, teacher^s style fall on this, continuum: ^ ^ , , 

open classfoora j . ' ^ ' ^ ^ ^ ^^authoritarian 

child centered . . . / ^ ^ traditional classrran 

I found open child-centered cl« jsrpocis to be condusive to inquiry learning while 
authoritarian ^aditional classrooms to hinder' or suppress Inquiry learning o 

6. Does the teacher direct the students to exercise inquiry processes? (see handout . 

for list) ^ / ^ , 

7. When reviewing content or processes done previously in class, does the teacher 

illicit the information frcxn the stiidents with questions, engaging chem and 
^ exercising their thinking skills? 
8« How. confident and relaxed doei; the teacher seem doing inquiry/process science? 

Student Behavior ^ \ ' * \ ^ 

i. Do the students pose ques^tions freely, reflecting curious, inquiring minds 

as well as ani environment that is safe and encouraging thera.te.do so? 
2* Do student remain on, task and denonstrate appropriate bdidvior? (i.e. do 

they demonstrate independent learning skills?) 

Design of Activity Itself 

1. Is there an initial question to answer or problem to solve? (i.e. ai^the stu- 

dents engaged in problem solving?) 

2. Are ithfe students actively involved in the physical manipulation of materials^ 

(hands-on learning) - / 

Riysical Evidence in Classroo m . 

1. Are there materials available aroiind the room for students to freely mess about 

with and 6l observe? \ 

2. Are thealearning centers or science centers with materials and books for in- 

dependent inquiry? ^ 
3* Any other signs of inquiry/liands-on learning? 



Wliile writing up my observations for each Lesson I evaluated, I used this 
organization£il format: . ' " . 

1. Class size - # of students 

2. Grade level ' 

3. Indj.cate ongoing unit / beginning of new unit / one-shot lesson 

4. indicate topic 7 concept / problem 

5^ "Description of lessph (including material, teacher and /student roles) 
-t). Evidence of hands-on inquiry/process science (see criteria deisciribed earlier) 
-7^ Effective classroom maxiagBnent 

Reflection time, sm»Tiari2c(tion of lesson/concept/skill 
Integration^ of science and writing , 

If -^S-above is not refered to in the evaluation^ then it shoud be assumed that it 
did not occur. 
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^ THE PROCESSES IN SCIENCE 



Processes are Rental activities that are used to acquire knowledge/ 
Processe^^. are iaportant to the teacher because they .are the seans by 
which the piq>ils become More efficient at problen-solving anci /^ainiag 
general knowledge including facts, cj^ncepts, skills, techniques, J. 
attitudes, and yalues* » n r 

Som processes which havo beoa found to have relevance for 
science teaching are listed below: 



9ASIG PMCSSSKS 

Communicating 
Cla9%ifying 
UHng numlierB 
Measuring 
Inferring 
Fr0dieting 
I 



XMrMGEArXD PEpCKSSgS 
.Ccktrolting. vaHabt$9 
r Defining ffp^raHonally 

I Interpreting ^'4at€t 

, Sxpmrimmting 



fERiC 



HIERARCHV OFiTOE INQUIRY PROCESSES 




CcM rtMittfiif 

|CoMtr«l1fii|%vtrUk1es . 

» I I ■ 

I K««tttr1fi9 
I Using R^abcri 

^ ^ CeMtMRic«t4fig 
Observing 



lower lt¥f'i 



The indapeytde^t learner exercieee creativity in inquirif. 



To r 0.. ' O 
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Chronology: Partners in Elementary Science <NSF/PIES) 

Winter-Spring 1987: Recruiting 1987 NSF/PIES Fellow©. Two 
all-day Saturday workshops (F^b. 28 » March 14) designecf. 1;o 
introduce inquiry science and process writing, and to build 
community. Pre-institute evaluation interviews conducted* 

Rummer 1987;: Three-week summer workshop (July 6-24). rThe 
first week was an intensive science program. The second and 
thrid weeks included science workshops in the morning -for 
participants. During the afternoons participants developed 
and taught science classes^ for the Migrant Education 
Project* Weekly evaluations! s 

Winter 1987-1988: three release day activities and four 
after-school workshops brought NSF/PIES Fellows together to 
share their classroom experiences and be introduced to 
^additional resources. . 

Oct. 16 Reunion/Workshop (all-*day) , Franklin Pattertran 
Hal 1 , Hampshi re Col 1 ege 

Dec. 7 Reception/Workshop for PIES Principals 

Jan. 25 Project Learning Tree Training, tall-day) 
Franklin Patterson H^H* Hampshire College 

After-school Workshops by Fellows and Staff, Red Barn, 
Hampshire College Feb. 24, March/ T, April, 7) 

April 5 Re-scheduled (snow) Principal's workshop, 
Hitchcock Center ^br the Environment 

A half-time PIES Resource teacher working with the Fellows 
in their' classrooms.. The evaltation program continued with 
interviews, written questionnaires. Two NSF/PIES Fell\3ws^ ! 
present projects at the Massachusetts Teachers Association 
Conference, March 1988. 

Spring 198Bs Recruiting 1988 NSF/PIES Fallows (mucl;i of the 
recruiting was done by the 1987 Fellows). Two all-day 
^Saturday workshops (Manch 5, April 9) simiijar to those the; 
previous year^ Pre-institute evaluation interviews of new < 
FelloHSk 

Summer 1988: Three-week institute for 1988 NSF/PIEC )Fellows 
(July 5-22) following a similar pattern to the previous 
year, but with more science-focused wu; /rshops. Ten of the 
,1987 Fellows completed curriculum packets. Weekly, 
evaluations of -the institute. - 



Winter 1988Ti9895 Ag&in three-release days and, four after- 
school events. 1988 NBF/PIES ^Fellows invited the 1987 
NS^/PIES Felldiis tc^ parti cipiite in all of these ->e\!rents.^ 

.Sept^ 29. Workshop and Reception for PIES Principals 
<af ter^school « Red Barn, Hampshire College) 

Oct. 12/13 BEHS Master (Universi'ty of California, 
Berkely) Teacher Training Workshop <r;pleast* day) Campus 
Center^i University of Massachusetts^ 

Hov, 15 Presentation of Summer Curriculum Packets and 
P^t Luck Supper, Red Barn, Hampshire College 

Jij'i 23/30 Pi at V Museum: Resources at Amherst College 
(after-school ) 

Feb. 6: Lunar Sample Workshop for teachers r^equesting 
Resource Teacher\to bring samples to the cl.assroom 
(after — school) Amherst High School 

' , ' 

Feb. 27/28 Evaluation Students' Progress in Science 
(af tf^r-school ) Hitchcock Center for the Environment 

- ^' ■ ■ „ - : :> 1 . ■ 

Harch 28. Water Powers TResources, in Hoi yoke f release 
day) Hqlybke Children's Museum and adjacent Heritage 
. Park Muse^i£^» ' 

' April 25i '^i^^t Annual Elementary Science Conference . 
, -First event' open to all Eiemeritary^ teachers, (after- 
^schoolJi^ Franfclin Patterson Hall, Hampr'iire College 

• • , : I 

May 24. Post-PIES Planning Meeting and Closiing Picnic, 
Red- Barn , '{Hampshire ^ Col lege 

ihlalf-time Resource Teacher- continuing to work with Fellows. 
Evaluation interviews and i^ritten quest ionnaibres for both 
cycle of Fellows continued. . Panel presentation at Norteast 
Regional NSTA Meeting, Portland, ME, October 1988. Wanita 
Sioiii Laf fond, 1987 NSF/PIES Fellow and 1988 staff member, 
selected Lucreti a Crocker Fellow to spend 1989-1990 
visiting ^classroom across T'^'^sachusetts giving workshops in 
"Hs^ndsrrOn, MindsHDn Science." i 
* , " ' ^ 

\iumr4Br 1989: Eight NSF/PIES Fellows worked with Co-Director 
Ridrtard Konicek ^o test PIER projects using construct ivist 
ispproach- 

Winter 1989-1990: Two release-day and four after-school 
workshops scheduled to continue NSF/PIES activities: 

Oct. 3. ^Evaluating Student's Understanding of Science 
(PIES Fellows only, all -day) Willits-Hallowell Center, 
Mount Hoi yoke College. 



Jan 10. Second Annual Partners in Elementary Science 
Workshop (all-day) Carr Lab-, Mount Hdiyoke College 

Four Friday afternoon seminars: Betting the Word Out: 
Preparing A Workshop <Feb. 2), Preparing for Conference 
Presetations (March 2) , Writing for Professional 
JourJials (March 28) , Finding Small Amounts of Money for 
Good Projects (April 27) . / r 

Follow-up interviews and questionnaires, four papers being 
prepared for publication. Planning meetings for 1990-1991 
academic year scheduled fpr April -June- Poster presentation 
at AAAS, February 1990. 



] 
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Appendix 

END 

. S . Dept . of Education 

Offica of £ducat:icn 

Research and 
Improvement (OERI) 
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Date Filmed 

> 

March 29, 1991 



